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ABSTRACT 



The objective of this study was to compare alternative 
approaches to the cost-effectiveness analysis of a technologi- 
cal change at the Naval Air Rework Facility, North Island, 

San Diego, California. Previous studies were reviewed and 
updated. Econometric techniques were employed to develop 
additional methods. Each of the methods was used to predict 
costs for situations both before and after the technological 
change. These predictions were compared as to their impli- 
cations concerning the cost-effectiveness of a computerized 
work-in-process management information system. 



2 



iV- 



t 



I k 



4 tV • ^ 

t I. r - :♦ 

! i { 'iff' z*>j 
• i lC|f**n ii n 

liifmo^t t 



TABLF OF CONTENTS 



I. INTRODUCTION 9 

A. BACKGROUND 9 

B. PROBLEM ADDRESSED 11 

C. EARLIER ANALYSES 14 

D. SCOPE OF THIS THESIS 15 

II. SITUATIONAL COMPARISON 17 

A. METHODS OF DATA COLLECTION 17 

B. MODIFICATION OF DATA ELEMENTS 18 

C. CHANGES IN SUBPROGRAM MIX - AIRCRAFT 19 

D. ENGINE PROGRAM 2 2 

III. ALTERNATIVE MODEL FORMULATIONS 24 

A. VARIABLES: DEFINITION AND CHOICE 24 

1. NORM (Number of Required Manhours) 24 

2. DMHR (Direct Manhours) 25 

3. DLBS (Direct Labor Expenditures) 25 

4. P^- (Price of Labor) = 25 

5. DML$ (Material Expenditures) 26 

6. DOH$ (Overhead Expenditures) 26 

7. NDAYS (Number of Calendar Days that 

Equipment Remains at NARFNI) 26 

8. Pj (Penalty Cost) 27 

9. NIS (Number of Jobs) 27 

B. DAILY PRODUCTION MODEL 28 

1. Formulation 2 8 

2. Assumptions 28 



3 



3. Procedures 30 

4. Role of Model in Cos t-Ff f ectiveness 

Analysis 30 

C. DAILY COST MODEL 31 

1 . Formulation 31 

2. Assumptions 35 

3. Procedure 36 

4. Role of the Model in Cost Effectiveness 

Analysis 37 

D. LINEAR ECONOMIC MODEL 38 

1. Formulation 38 

2. Assumptions 3R 

3. Procedures 39 

4. Role of the Model in Cost- 

Effectiveness Analysis 41 

E. JOB COST MODEL 41 

1. Formulation 4 2 

2. Assumptions 4 3 

3. Procedures 46 

4 . Role of the Model in Cost- 

Effectiveness Analysis 48 

IV.’ RESULTS OF EXERCISING MODELS 49 

A. DATA BASE 4^ 

B. DAILY PRODUCTION MODFL 49 

C. DAILY COST MODEL 5 0 

D. DAILY COST MODEL, EXTENDED 5 2 

E. LINEAR ECONOMIC MODEL 54 

F. JOB COST MODEL f^5 

1. Preparation ^5 

2. Regression 65 

3. Prediction 69 



4 








♦ 



I 



4 . 

Ill . . 



* '■ ^rnm 

— 






j*. 



» 











V. COMPARATIVE USEFULNESS OF THE MODELS IN 

COST-EFFECTIVENESS ANALYSIS 84 

A. MODEL LIMITATIONS 84 

1. Linear Economic Models 84 

2. Daily Cost Models 8 5 

3. Job Cost Models 85 

B. INTERPRETATIONS OF MODEL HARMONY OR 

DISCORD 85 

C. IMPACT OF OTHER FACTORS 89 

VI. CONCLUSIONS AND AREAS FOR FUTURE STUDY 91 

A. CONCLUSIONS 91 

B. AREAS FOR FUTURE STUDY 91 

APPENDIX A: JOB COST MODEL REGRF.SSION PROGRAM 94 

APPENDIX B: JOB COST MODEL DUMMY VARIABLE 

COEFFICIENTS 113 

BIBLIOGRAPHY 124 

INITIAL DISTRIBUTION LIST 125 

FORM DD 1473 127 



5 



LIST OF TABLFS 



Table 

I. LIST OF AIRCRAFT TYPE/WORK TYPE COMBINATIONS 21 

II. DIFFERENCES BETIVEEN PREDICTED COSTS - 

AIRFRAMES 53 

III. CORRECTED PENALTY COSTS 60 

IV. BEFORE WIPICS LINEAR MODEL MATRIX VALUES 61 

V. AFTER WIPICS LINEAR MODEL MATRIX VALUES 62 

VI. BEFORE WIPICS ACTIVITY VECTOR 63 

VII. AFTER WIPICS ACTIVITY VECTOR 63 

VIII. LINEAR MODEL RESULTS - TOTAL COST 64 

IX. LINEAR MODEL RESULTS - OPERATIONS COST 64 

X. LINEAR MODEL RESULTS - PENALTY COST 64 

XI. VERSION 1 BEFORE WIPICS TOTAL COST 70 

XII. VERSION 1 AFTFR WIPICS TOTAL COST 71 

XIII. VERSION 1 BEFORE WIPICS OPERATIONS COST 72 

XIV. VERSION 1 AFTER WIPICS OPERATIONS COST 73 

XV. VERSION 1 BEFORE WIPICS PENALTY COST 74 

XVI. VERSION 1 AFTER WIPICS PENALTY COST 75 

XVII. VERSION 2 BFFORF WIPICS TOTAL COST 76 

XVIII. VERSION 2 AFTER WIPICS TOTAL COST 77 

XIX. VERSION 2 BEFORE WIPICS OPERATIONS COST 78 

XX. VERSION 2 AFTER WIPICS OPERATIONS COST 79 

XXI. VERSION 1, TOTAL COST, COMPARISONS 82 

XXII. VERSION 1, OPERATIONS COST, COMPARISONS 82 

XXIII. VERSION 1, PENALTY COST, COMPARISONS 82 



6 




1 



XXIV. VERSION 2, TOTAL COST, COMPARISONS 83 

XXV. VERSION 2, OPERATIONS COST, COMPARISONS 83 

XXVI. COST DIFFERENTIAL COMPARISONS 82 



7 





i 



LIST OF FIGURFS 

Figure 

1. Production Functions, Clear Results 32 

2. Production Functions, Mixed Results 32 

3. Model Predictions 80 



8 



I 



I 






I. 



INTRODUCTION 



After changes have been made in the operating procedure 
of an industrial organization, the question arises, "Was the 
change worth the cost?" That cost may be couched in terms 
of effort, time, friction, inconvenience or, most likely, 
money. This thesis will be concerned with addressing that 
question, as well as one that naturally follows: "Now, how 

believable is the answer given?" 

A, BACKGROUND 

Since the beginning of calendar year 1972, the Naval Air 
Rework Facility, North Island (NARFNI) , has been engaged in 
the test and use of an industrial management information 
system known as the Work In Progress Inventory Control 
System (WIPICS) . As implied by its name, NARFNI is one of 
seven Naval Air Rework Facilities (NARF) which are respon- 
sible for reconditioning U.S, Navy and Marine Corps aircraft. 
Such reworking includes the overhaul, modification, modern- 
ization, preventive maintenance, and repair of a number of 
different kinds of aircraft and included components. It also 
serves a small number of aircraft and components each year 
from the Air Force and Coast Guard, where such aircraft match 
Navy models. The NARFs operate from the Navy Industrial Fund 
(NIF) which provides their operating capital base. Customers 
of the NARF services are charged against their operations and 
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maintenance funds (typically) for the rework services on 
either a cost-reimburseable or fixed price basis. The 
majority of the work is of the fixed price variety, a provi- 
sion which is intended to promote cost-minimization at the 
NARF . Neither growth nor depletion of the NIF is desired, 
so the NARIfe are expected to maintain zero profit on their 
operations . 

The introduction of WIPICS, then, represented a technolo- 
gical change at NARFNI in the method of managing its in- 
process workload. The change was unique to NARFNI in that 
WIPICS was not installed in the other NARFs. WIPICS is a 
computerized information system which receives input data 
from many different control points in the rework process 
concerning the many different jobs being accomplished on 
inducted aircraft and their components. At each of a myriad 
of well defined disassembly, revrork , repair, modification, 
assembly and test junctures, coded status reports are entered 
into the electronic files concerning each aircraft or com- 
ponent. Input is made via push-button telephone sets located 
throughout the plant complex. Information concerning the 
status of a specific aircraft undergoing rework can be 
retrieved from storage and output through the telephone by 
means of a limited capacity audio response unit and through 
teletypev;riter terminals. In this way WIPICS was designed 
to allow many levels of the NARFNI management to be able to 
follow the progress of the many processes underv/ay in the 
plant. The managers of the six NARFNI divisions may also 
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use WIPICS to plan their workloads by determining the status 
of antecedent operations. With such capabilities it was 
anticipated that WIPICS would benefit the NARFNI by: 

1. allowing positive control of all work-in-process 

2. reducing turn-around time for repairs 

3. improving production rates [3, p. 9], 

In the role of an information system, WIPICS would 
replace a much less responsive system known as the Uniform 
Automatic Data Processing System (UADPS) . UADPS depended 
upon equipment which has rapidly become obsolete by advances 
in computer technology. WIPICS provided a step up to a 
real-time capability for information storage and retrieval. 
UADPS was able primarily to store and accumulate historical 
data which was output ^ masse by accounting equipment. 
Specific job information was difficult to obtain and not 
timely when obtained. The UADPS summary outputs proved to 
be too far after-the-fact to provide real assistance to 
management in controlling day-to-day operations. Explanation 
of the organizational structure into which WIPICS was inserted 
was given in detail in theses by Spooner, Myers and Bradley 
[6 , 3 , and 1] . 

B. PROBLEM ADDRESSED 

Naturally, WIPICS has associated with it costs that were 
not incurred prior to its introduction. Certainly the added 
informational capability provided a benefit in itself. How- 
ever, one could well argue that such a capability by itself 
was actually a luxury for which tax dollars need not be 



11 




■4 




4 



spent, and other benefits, if any, would have to be demon- 
strated. The information, if it did help to "positively 
control the work-in-process," should have been valuable in 
dealing with schedule bottlenecks, material shortage delays, 
and other similar work slowdowns. Hence, this positive 
control ability should have been able to activate a quicker 
remedy at the point of concern. In looking for the answer 
to the question, "Is it worth the cost?," it is possible to 
consider the V7IPICS impact on production time required for 
the jobs handled. If it were possible to assume that the 
workloads before and after WIPICS was installed were almost 
identical (or at least closely comparable) , one might safely 
use averages of production time data to ascertain if any 
benefit had been gained. The required similarity of the 
workloads, however, was definitely not the case, and this 
forces the search for a different measure of effectiveness. 

It is possible to consider changes in the workload 
handled by the NARFNI and ask if there was an increase in 
the productive capability because of the greater efficiency 
and "decreased turn-around time" due to WIPICS. In order to 
make such a comparison between the capabilities before and 
after WIPICS, there would have to have been a high degree of 
constancy in the work force and identical job mixes across 
the compared periods. To the contrary, the work force 
suffered great variation and NARFNI faced very different job 
mixes over the time periods involved. Hence the search for 
a measurement goes on. 
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The pattern described by the examples above was repeated 
often as examination was made of various ways to approach 
the basic question of cost effectiveness determination within 
a dynamic industrial operation. The problem became one of 
distilling the many internally changing situations and pushing 
forward a means of capturing before and after "snapshots" of 
the operation. Within these "snapshots" must be some reason- 
able estimates of costs which can be compared. That distil- 
lation process is not unique, as many techniques provide the 
opportunity for before and after comparison. Hopefully, 
clear-cut differences between performances in the two periods 
of time would be evident no matter what procedure was used. 

In view of the inadequacy of the seemingly obvious indi- 
cators of benefit, the problem of how to ansv;er the question, 
"Was the change worth the cost? , " had to be attacked less 
directly. A strategy was developed to approach an ansvrer 
by the following broad steps: 

1. determining those models capable of representing the 
dynamic industrial situation and its cost flows 

2. collecting data needed by the models and using the 
models to produce their intended "snapshots" of cost informa- 
tion 

3. analyzing the "snapshots" for evidence of significant 
changes in costs 

4. analyzing the models to check the validity of their 
outputs 
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5. comparing alternative models of the same structure 
to determine harmony of the results 

6. drawing those conclusions allowable from the models, 
their outputs, and their intercomparisons. 

C. EARLIER ANALYSES 

References 1, 3, 6, 8, and 9 represent earlier attempts 
to proceed within the framework discussed above. Spooner 
[6] detailed the approach procedure and indicated models that 
would be applicable to this kind of economic analysis. He 
identified the difference between the continuous and discrete 
approaches to the problem. He also noted t^e data elements 
readily available for analysis and indicated methods for 
handling the data. 

Bradley [1] undertook the development of methods for 
analyzing the NARF cost flov; by a continuous model v/hich made 
use of aggregate daily statistics that were generated from 
the NARF ' s records of individual jobs. His work also was 
able to estimate production functions characteristic of the 
time period before WIPICS was in use . 

Myers [3] developed a linear programming approach to the 
analysis of the NARF cost flov7. His model made use of data 
on each particular kind of job and its use of constrained 
resources. His work also produced an estimate of the costs 
of operation before WIPICS was in use. 

Trafton [8] extended Bradley's work and computed cost 
functions based on tv/o continuous models. His work developed 
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representations of the before WIPICS situation based on Cobb- 
Douglas and Constant Plasticity of Substitution (CPS) Produc- 
tion functions . He also used data from the pre-WIPICS period 
to check the validity of the resulting cost functions. 

Tye [9] investigated the validity of the Cobb-Douglas and 
CPS production functions to determine their validity for 
characterizing the productive operations at NARPNI. He had 
available data from the period after WIPICS was installed 
and was able to make some initial comparisons between the 
before and after situations. 

The five theses mentioned above, along v/ith this thesis, 
are related to an on-going analysis effort undertaken by the 
Department of Operations Research and Administrative Sciences 
of the Naval Postgraduate School in conjunction with the 
Navy's Management Systems Development Office (MSDO) . MSDO 
was charged with the task of developing the methodology for 
evaluating the management tools in use or contemplated at the 
seven NARPs. Specifically with regard to WIPICS, MSDO is 
charged with providing cost effectiveness information to be 
used in a decision to extend WIPICS implementation t'^ other 
NARPs . 

D. SCOPE OP THIS THESIS 

The present work is aimed at bringing together a number 
of comparisons that have been started in earlier works. The 
linear programming model will be used to portray the after- 
WIPICS situation and compare it to Myers' results . Another 
continuous model will be introduced and evaluated. It will 
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be used to provide its own comparison of the before and after 
WIPICS periods. The results of Bradley, Trafton and Tye will 
be summarized and their comparisons highlighted. Then various 
models will be exercised, using common sets of data, to test 
the degree of harmony among the m.odels. The collecti.ve 
results of these measuring tools will then be used to draw 
conclusions about the ability to perform cost-effectiveness 
evaluations in this kind of environment. 
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II. 



SITUATIONAL CONPARISON 



As noted in Chapter I , a naive comparison of obvious 
performance factors was guilty of grave oversight beca\ise of 
changing conditions at NARFNI, This chapter will set forth 
some of the more important elements that underv/ent change as 
seen in comparing the before and after situations. 

A. METHODS OF DATA COLLFCTIOM 

The first change and the one for which the analysis is 
undertaken, concerns the manner in which operational data 
was collected. This is, of course, the heart of the WIPICS 
inovation. Prior to WIPICS, information concerning the 
status of individual jobs undergoing processing in a given 
department was collected by hand-written record in departmen 
tal logs and required reports. Other status information of 
possible value was often collected in supervisory personnel 
memories. By adding the UADPS capability, the scribed 
reports were f 02 rwarded to centralized locations for record 
file updating and storage and for collective reproduction by 
unit record equipment. Myers [3, p. 11] provides a compara- 
tive description of UADPS and WIPICS which indicates the 
relatively slow and cumbersome nature of the UADPS. 

WIPICS was then introduced into the shop operations to 
improve both the reporting and the record keeping functions. 
WIPICS provided the capability of direct access by the 
operating units to the status files of jobs in their domains 
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The status updating was done instantaneously by shop personnel 
sending progress information from push-button telephones 
directly to the electronically maintained files. These same 
files can be queried by supervisors, departmental and divi- 
sional managers, and staff members to obtain specific reports 
about individual jobs, departmental workloads and interdepen- 
dent operations. Further details and specific operating 
descriptions about WIPICS are found in Bradley [1, p. 22-26] 
and Spooner [6, p. 11-19]. In essence, then, the change was 
one of speed and availability of the information, as Myers' 

[3, p. 11] chart points out. This change constituted the 
basic impetus of the analysis effort. 

B. MODIFICATION OF DATA ELEMFNTS 

Basic to the financial and managerial accounting effort 
at any industrial site is the classif ication of the productive 
inputs as to directness/indirectness of applicability to the 
product. Both labor and material usage contain direct and 
indirect elements. At NAPF, material usage can be considered 
primarily direct because of the nature of both the material 
and the work ta be accomplished. Determination of the number 
of direct manhours is, on the other hand, subject to constant 
reinterpretation . 

The number of manhours expended (or budgeted) is often 
central to evaluative and planning efforts, especially in 
the governmental arena. Manhours directly attributable to 
the product are characteristically prime examples of the 
"variable" input. Hence the effort is expended to separate 
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the labor time and expenditures into the direct and indirect 
categories . Such separations change from time to time by 
management policies as new interpretations are made of the 
"directness" of given labor categories. Most of these cate- 
gories retain their direct/indirect label over time without 
switching, but others vacillate over time as a result of 
differing judgemental factors applied and differing repair 
program emphases. In addition to policy changes, labor time 
and spending are subject to some clerical reinterpretation 
and error of classification. If the policy and clerical 
reclassification of labor were extensive, there would be 
considerable scepticism as to the reliability of direct labor 
data for measuring productive effort. Fortunately, the 
direct manhour determ.inations which are stable account for 
nearly all the direct labor on a percentage basis. Thus the 
peripheral areas which might change classification are 
insignificant in their impact on variable labor input infor- 
mation. Therefore, unless more extreme fluctuations occur, 
this source of change should not affect the WIPICS question. 
(For cost accounting procedures at NARFMI, see Ref. 4.) 

C. CHANGES IN SUBPROGRAM MIX - AIRCRAFT 

As indicated in the introduction, the workload of NARFNI 
changed in character over the time periods under scrutiny. 

The aircraft program reflected this change in that the mix of 
subprograms before WIPICS was not the same as that after 
WIPICS. Myers [3, p. 17] identifies twenty different aircraft 
upon which NARFNI performs eight different kinds of rework. 
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In neither the before or after case were all IfiO of the 
possible combinations encountered. Using this background, 
the before and after WIPICS workload can be compared as 
shown in Table I. As indicated there, 20 combinations are 
common to both periods. These twenty common combinations 
will be used in a number of the comparisons of succeeding 
chapters. It is worthy of note that approximately 70% of the 
total aircraft activity is associated with the common com- 
binations in each period. The after WIPICS period data did 
not include any aircraft of four models which were treated 
before WIPICS. No new aircraft models were introduced after 
WIPICS, however. 

Similarly, the type of work performed changed in terms of 
relative importance over the periods. This can be seen in 
the shift to different work types for a given aircraft. 

Another factor which is not explicit is the reworking of air- 
craft for which the normal lifetime has been extended. 

Instead of purchasing new aircraft as had been planned, older 
models have been reconditioned and returned to service. 
Naturally, the older aircraft often required more extensive 
repair and Progressive Aircraft Rework (PAR). Hence, as 
aircraft in the after WIPICS period were generally older, 
the effort required for their rework increased. 

Further classification of work types had been envisioned 
by Myers as he included a provision for recording the PAR 
cycle number of a job. This would have indicated how many 
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times the aircraft had undergone "treatment” at the NARF. 

This would have provided a means of distinguishing between 
older and younger aircraft undergoing a given type of rework. 
However, due to the complexity of tracing this information 
it was not available for the after-WIPICS period. Conse- 
quently, data of the earlier period have been reclassified 
to ignore the cycle information. The number of required 
manhours (NORM) will reflect such aircraft age differences j 
since the NORM of an older aircraft can be expected to be 
larger. Though the cycle information is lacking, the NORM 
data should provide compensating coverage. 

D. ENGINE PROGRAM 

The engine program, second of the major NARF programs, 
was not included in WIPICS in the present implementation. 
Because of its exclusion from WIPICS, it might be possible 
to draw inferences about activity level and subprogram mix 
influences on overall plant activities. The engine program 
underwent changes in subprogram mix similar to the aircraft 
program. Myers [3, p. 16] also codes the engine and work 
types, accumulating 26 and 5 possibilities, respectively. 
Comparative tabulation is not included for the engine program 
since it will not be directly involved in the before and 
after WIPICS comparisons. 

The exclusion of the engine program does raise a number 
of questions about the WIPICS impact. Some of these are: 

1. Are there gaps in WIPICS aircraft program coverage 
due to engine program exclusion? 
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2. Does the exclusion hamper WIPICS scheduling cpaability? 

3. Can WIPICS be extended by anology to the engine 
program? 

Though these questions will not be addressed directly, they 
provide another avenue for investigation. The aircraft 
program examination, however, can treat these questions as 
independent. 
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III. ALTERNATIVE MODEL FORMULATIONS 



In order to deal with the situational changes discussed 
in the last chapter, a number of alternative models have been 
developed to portray the economic interactions of NARFMI. 

Each of the models approached the problem of typifying the 
operational characteristics from a slightly different perspec- 
tive. Nonetheless, each drew certain key information from a 
common data base. This data base was taken from financial 
records of individual rework jobs published quarterly by each 
of the NARFs under the title. Production Performance Report 
(PPR) . The models and their essential variable components 
are discussed in this chapter. 

A. VARIABLES: DEFINITION AND CHOICE 

Each of the mathematical models presented relies on 
different subsets of the information conveyed by the follow- 
ing variables : 

1 . NORM - (Number of Required Manhours) 

This is determined a priori by negotiation between 
the NARF and the Navy as an estimate of the amount of direct 
labor input that will be required to perform a given rework 
operation on a given type of aircraft, engine, or component. 
This variable is often included in order to provide a before- 
the-fact weighting of jobs of different models and rework 
categories. To a limited degree it provides an "index of 
difficulty" to characterize the rework job. 
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2 . DMHR (Direct Manhours) 



This data element is the number of direct labor hours 
charged against a particular job order. This a posteriori 
measure is the accumulated labor time directly associated 
with productive jobs. The usual accounting conventions are 
employed in determination of this factor, subject to the 
insignificant fluctuations noted previously. 

3 . DLB$ (Direct Labor Expenditures) 

This factor is the actual dollar amount expended for 
input direct labor services. As such it includes both time 
and wage rate effects. A wide variety of skills and exper- 
ience levels at the NARF can be combined in many different 
ways to accomplish required jobs. This item prices out the 
DMHR at the rate earned by each of a wide variety of skilled 
workers. Thus it responds to changes in the particular mix 
of skills used on each job. Experience levels are similarly 
reflected in this composite measure, and it is in this area 
that changes in personnel ceilings become noticeable. 

4. (Price of Labor) = 



This rate is the effective wage rate for a given job 
or aggregation of jobs. This quotient can be used to compare 
distinct jobs or distinct aggregations of jobs on the basis 
of labor intensity. This factor also responds to the kind 
of labor force mix fluctuations noted above. For example, 
whenever a reduction of the work force occurs, those most 
often affected are the lower paid. Then, although a compar- 
able number of DMHR will probably be expended for a given 
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job, they will be paid for at the higher rate of the remaining, 
more experienced workers. 



5 . DML$ (Material Expenditures) 

This measure is the total cost of all direct materials 
used for a given job, priced on the basis of individual item 
costs. Adding the detailed complexity of item enumeration 
would be excessively superfluous, since there is such a wide 
variety of materials used and they are not comparable from 
job to job or from one time period to another. 

6 . DOH$ (Overhead Expenditures) 

This amount is defined in the usual accounting sense 
and is applied to each job on the basis of the number of 
expended direct manhours. It includes roughly all other 
expenses of operating the NARF that would be paid from the 
NIF. This factor would be affected by overall workload 
changes. Any fixed operating costs v/ould tend to keep this 
item high during periods of lower production while they v;ould 
be spread thinner at higher levels of production. 

7 . NDAYS (Number of Calendar Days that Equipment 

Remains at NARFNI ) 

By implication this measures the number of days the 
equipment is not available for operational committment because 
of being in rework. It is also directly proportional to the 
actual number of work days required to complete the job. As 
the latter, it would reflect such conditions as material 
shortages, increased efficiency, abnormal congestion, and 
job complexity. 
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8. Pj (Penalty Cost) 

This price represents the daily cost of not having 
a given piece of equipment operationally available. The 
product of this factor and NDAYS represents the "pipeline" 
cost associated with having a given aircraft or component 
in the rework system. 

9 . NTS (Number of Jobs) 

This integer valued variable is the number of actual 
jobs in process in a given major program (aircraft, engines, 
etc.) on a given day. It was gained from knowledge of the 
following data items: 

a. IND - Induction date 

b. PD - Production date 

These are, as their names suggest, the dates on which the 
aircraft, engine, or component entered and departed the NARF 
respectively. A job was accumulated on a given date if that 
date fell on or between the IND and PD. 

The variables described above are those found to be most 
useful in analyzing NARFNI activity. In his thesis, Spooner 
16] described several methods for characterizing the relation 
ships among these variables which would be of value in the 
analysis effort. Though he did not employ the methods, two 
of his contemporaries and two successors did use the methods 
he indicated and extensions of those methods. The remaining 
sections of this chapter will present the models that were 
developed and a discussion of each. The particular variables 
selected from among the foregoing take on, in addition to 
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their denotative definition, special surrogate roles depending 
on the way they are handled in each model. 

B. DAILY PRODUCTION MODEL 

1 . Formulation 

In his work to develop a model of NARFNI production, 
Bradley [1] chose to consider a depiction of the daily output 
of aircraft and engines expressed in terms of NORM. He used 
the job oriented data from the Production Performance Reports 
to develop a daily flow of DMHR, DLB$ , DML$ , and NIS by means 
of aggregation routines. With these variables he constructed 
this Cobb-Douglas production function [1, p. 54] 

APH = A(APL)°‘ (APD)^ (APM)”^ (NIS)*^ 

Where 

APH = aggregation of prorated NORM over all jobs in 
process on a given day 

A = constant multiplier 

APL = aggregation of a prorated DMHR over all jobs 
in process on a given day 

APD = aggregation of prorated DLB$ over all jobs in 
process on a given day 

APM = aggregation of prorated DML$ over all jobs in 
process on a given day 

NIS (as defined in Section A) 

2 . Assumptions 

As a basis for this particular attack, Bradley assumed 
that NORM represented a utility both to the customer and 
NARFNI [1, p. 42-32]. He used that utility to express the 
otherwise diverse output of the NARFNI in NORM as a common 
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term. Hence, the daily output on a particular job was con- 
sidered to be the completion of a certain percentage of that 
job's NORM. The sum over all jobs in the program then v;as 
taken as a measure of a day's output. 

Having decided upon this output measure, Bradley 
chose the inputs for their contribution to the productive 
process. The measure of direct manhours was included to 
account for the "physical units of labor consumed." The 
total direct labor cost was also absorbed to add the impact 
of the varying skill levels. "It was considered that both 
total manhours expended and some consideration of the value 
of manhours expended would have separate effects on produc- 
tion" II, p. 45]. DML$ was added to reflect the requirements 
of material usage on production. The aggregation process 
assumed that the expenditures of manhours (with associated 
labor dollars) and materials and consequent production of 
NORM flowed in an even daily pattern for a given job. This 
abstraction was used in lieu of a more realistic, but non- 
available, job production flow pattern. Aggregation techniques 
proceeded under the additional assumption that work continues 
seven days per week beginning on the induction date through 
but not including the production date. This assumption, while 
clearly not correct, merely has the effect of reducing the 
work on any given day by a proportionality factor. The vari- 
able NIS was included to account for the work flow present 
in the system at the time. It also was used to portray shop 
congestion effects. Its definition illustrates its own form 
of daily aggregation. 
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3. Procedures 



Data concerning activities of a time period under 
scrutiny were input to the prorate program described by 
Spooner [6, App. B] . Output consisted of the aggregated 
values required by the model, representing summaries of day- 
by-day operations in each of the three major programs - 
aircraft, engines, and component repair. 

In order to estimate the exponents of the three Cobb- 
Douglas production functions, a logarithmic transformation was 
performed on the basic model. This rendered: 

£nAPH = ^nA + d5,nAPL + B^inAPD + y^-nAPM + 6ilnNIS 

This transformation produced a form which was linear in the 
coefficients, and this form was appropriate for handling by 
regression analysis. Bradley chose the Biomedical Stepwise 
Regression Program to perform the analyses II, p. 55]. The 
program computed the estimates of the coefficients, associated 
standard errors, and other values of regression test 
statistics . 

4 . Role of Model in Cost-effectiveness Analysis 

Bradley anticipated being able to capture in the pro- 
duction function a picture of the manner in which the NARF 
utilized its resources. By comparing function characteristic 
of the before WIPICS period with another function determined 
similarly for the after WIPICS period, conclusions might be 
drawn about the effect of WIPICS in improving the productive 
effort. There exists the possibility of one of the three 
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situations depicted for illustration by a two-input function 
in Figures 1 and 2. These illustrations show iso-output 
production functions of two inputs. 

Should the results be as suggested by either case 
in Figure 1, a clear cut distinction betv/een the two periods 
would be possible and would lead to a definite statement as 
to the worth of WIPICS. Results of the type suggested by 
Figure 2 are more likely and would cause doubt as to real 
distinction between the periods especially if input combina- 
tions on both sides of the intersection iz^ ,z^ ) were 

■^a '^a 

feasible. Statements about the worth of WIPICS would have 
to be qualified by limiting the ranges of the inputs, and 
such statements would have to be tentative. 

Bradley's work was preliminary to establishing cost 
functions characteristic of the operations at NARFNI . The 
three production functions portrayed by him were intended for 
use as constraints for the problem of cost minimization. 

That usage was developed by two subsequent theses. 

C. DAILY COST MODEL 
1 . Formulation 

Spooner indicated in his analysis methodology that 
the developed production function needed to be used to deter- 
mine a cost function characteristic of each time period in 
question. Trafton and Tye [8, 9] undertook this effort and 
extended Bradley's work. They viewed NARFNI as operating to 
minimize costs subject to the developed production function. 
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Figure 1. Production Functions, Clear Results. 
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Figure 2. Production Functions, Mixed Results. 
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Hence they looked at two versions of that minimization 
problem. 

(1) Min C = ♦ APL + APM + AP_ 

J-i ± 

s.t. : APH = A(APL)“ (APM)”^ (NIS)^ 

(2) Min C = Pt • APL + AP^ 

J-i ± 

s.t. : APH = y[6(APL)"^ + (1-6 ) (NIS ) 

where AP^ is the aggregated penalty cost over all jobs in 
shop . 

The first version v;as built on the results of Bradley's 
work which showed the variable APD to be insignificant in 
explaining NORM. (Actual results on which this was based are 
given in Chapter IV.) The second version was developed from 
the more general Constant Elasticity of Substitution (CES) 
Production function, introduced into the analysis stream by 
Trafton. Both of these versions included cost contributions 
from both "operational" and "pipeline" sources. Thus both 
the actual NARFNI costs and a cost to the supply system/fleet 
for the awaited product have been considered. 

The form of the minimization suggested the use of the 
Lagrange multiplier technique, per Spooner [6, p. 29]. After 
forming the Lagrangian function, determining the gradient, 
setting the gradient equal to zero, and solving for cost in 
terms of the inputs (for derivation see Trafton, ref. 8, 
p. 16-21) , the respective cost functions of the tv;o versions 
were determined to be, after logarithmic transformation: 
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(1) £nC a + ^-n(APH) + ) + a+3+y ■*■ ^ 



(2) InC' = a' + £n[Pj^ + AP^ (NIS/APL) ] + 3'^.n(APH) + coD + e ' 



where 



a ' = 



- ? 



6 ' = =■ 



w = — 



D 



= £n 1(1-6) + 6 (NIS/APL)"*^] 



The data required to support work on these models 
consisted of the performance data that served as input to 
Bradley's procedures plus the lists of penalty costs developed 
by Myers for the linear programming approach [3, p. 39, 40]. 
Each penalty cost was based on the "average flyaway unit 
procurement cost" obtained from NAVAIRSYSCOM representatives 
[5] . The procurement cost for each type of aircraft was pro- 
rated evenly over its expected lifetime in days. Each engine 
procurement cost was spread over a ten year lifetime. Because 
of a lack of detail in the data for the component program, 
Trafton and Tye restricted their work to the aircraft and 
engine programs. 

The dependent variables used for the two versions 
differed due to the independent variables chosen for each. 

For the Cobb-Douglas version. 



C = APD + APM + APj 
The CES version used the definition. 
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C = APD+APO + APj 

where APO was the aggregation of prorated DOH$ (overhead) 
over all jobs in process on a given day, and AP^ was the 
aggregation of the penalty costs over all jobs in process 
on a given day. 

2 . Assumptions 

Building on Bradley's foundation, Trafton and Tye 
included his assumptions in the development of the models 
they discussed. Basic to their advancement beyond Bradley's 
work was the assiomption that NARFNI indeed sought to minimize 
costs subject to the production function constraint. That 
is, it was assumed that NARFNI tried to minimize the daily 
costs of performing required daily production, expressed 
in terms of NOFIM. This minimization was assumed to be 
imperfectly accomplished, which gave rise to the error term. 
The error terms e and c' , were assumed to be normally 
distributed with mean zero and constant (but distinct) 
variances. Hence, the minimization would be assumed to be 
accomplished with respect to standard costs which are implicit 
and probably not definable (beyond NORM and its compensated 
rate) . This allows both positive and negative cost variance 
(in the accounting sense) , corresponding to super-efficiency 
and waste, respectively. 

Another assumption stemmed from construction of the 
penalty costs. Here the basis for this pipeline surrogate 
was assumed to be the capitalized cost of the respective 
system. This would seem to be a minimum value to use, and 
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the straight line amortization probably had more validity 
than accelerated or usage-based rates which would have been 
hard to justify and determine. 

3 . Procedure 

Both Trafton and Tye made use of the proration program, 
modified by Trafton to include a daily proration of the 
penalty costs based on the type of equipment involved. This 
computer program produced from the job data cards another set 
of data cards representing the day-by-day dollar and manhour 
expenditures in the appropriate categories [8, App. D and E] . 
From the prorated data, a cost function based on the Cobb- 
Douglas production function was identified for the engine pro- 
gram and another for the aircraft program.. 

In order to attack the CES formulation, a two stage 
technique was used. First the least-squares estimation of 
the following relation was performed: 



Jln(NIS/APL) = a + bJln (AP^/P_ ) + e 

X ij 



where 



a 



( 




- 1 
P+1 



b = 



-1 

P+1 



The resulting estimate of NIS/APL was then substituted into 
version (2) for the variable D [9, p. 21]. The second stage 
regression was then run on the resulting relation of ver- 
sion (2) . 
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Trafton dealt only with before WIPICS data and esti- 
mated relations for the Cobb-Douglas and CES cost function 
for that period only. He validated the resulting model 
using nine separate 30 day periods to compute actual versus 
predicted values of total costs. 

Tye investigated the stability of the two models 
he had estimated from a slightly updated before WIPICS raw 
data set. Then he proceeded to estimate Cobb-Douglas and 
CES cost functions for engines and aircraft for the period 
after WIPICS was in use. Prediction intervals were calcu- 
lated for each of the cost functions. Then prediced cost 
differentials between the periods were computed based on the 
models . 

4 . Role of the Models in Cost-effectiveness Analysis 
With Tye ' s results, another step toward definitive 
conclusion was completed. The comparison of before and after 
WIPICS situations was the long desired goal. The cost func- 
tions developed by Trafton and Tye provided a basis for such 
a comparison. Exercising the model for prediction gave 
indication of what typical workloads would cost in each 
program in each time period. 

Tye also pointed out some of the reservations which 
must accompany any statements that are conclusions to be 
drawn from the comparisons of the models. He noted some of 
the externalities which were not handled by the models. 

Thus he pointed out the need for independent validation of 
the results. Such validation is the role of the models to 
follow. 
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D. LINEAR ECONOMIC MODEL 



1 . Formulation 

As Bradley was developing the Cobb-Douglas production 
function, Myers [3] prepared a linear economic model, as 
suggested by Spooner's methodology, to be used for validation 
of the continuous model results. In essence, this linear 
programming approach seeks the solution to the problem- 

Minimize Cost = actual dollar cost of resources used to 

accomplish Z (a vector of job NOPMIS) + 
the corresponding penalty costs for the 
jobs represented by Z 

Subject to: accomplishing a given total NORM level and 

remaining within set resource constraints 
with that Z. 

This represents a verbal discussion of the model for which 
Myers provides extensive mathematical detail [3, p. 27-29]. 
Separate models were again formulated for engines and aircraft. 

Data used in this model was not prorated by day, but 
was treated according to equipment type and work type. Codes 
were assigned for each distinct engine and aircraft model and 
for each type of rework undertaken on them. (The lists of 
codes were given as Tables I and II, p. 16, 17 of Myers' 
thesis.) Production activities were identified from the raw 
data, and a technology matrix was developed. Penalty costs, 
as discussed earlier, were introduced in this model. Myers 
emphasized that the model was not intended as a production 
management tool but, rather, provided only budget and penalty 
cost information. He did point out the possible usefulness 
of tradeoff information that does result [3, p. 30]. 
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2 . Assumptions 



Myers listed four assumptions concerning the linear 
economic model: 

1) The estimated processes (reworking of engine and air- 
craft) are linear functions and therefore these 
processes exhibit constant returns to scale. 

2) The above linear processes may be estimated by the 
aggregation of a finite set of observations over 
some time period. 

3) The NARF is not a profit maximizing organization, 
therefore the management objective of the NARF will 
be assumed to be minimization of costs subject to 
completion of all work demanded by the operational 
forces of the Navy. 

4) Prices used in the model are constant and may be 
estimated from the production data furnished by the 
NARF. [3, p. 26-27] 

The additional assumption concerning the penalty costs noted 
earlier was applicable here. 

3 . Procedures 



For the engine program, Myers used cluster analysis 
to determine the alternative processes available to the NARF 
to accomplish various kinds of work. A series of four compu- 
ter routines were used to develop distinct relationships that 
could be identified as "processes" [3, App. B-E] . These 
procedures examine vectors of input and output measures to 
determine any similarity among them. Here the notion of 
similarity was defined in terms of having approximately the 
same proportion of input resource usage for unit output. The 
clustering programs confirmed the uniqueness of the engine 
type/work type combination as processes. 

The engine data was then further sorted by calendar 
quarter in which the work was done. Where possible. 
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additional processes were identified by quarter within the 
work type. Dominance relationships were sought among the 
centroids of the processes. A program developed for that 
purpose was applied repeatedly until all dominance was 
removed among groups having the sam.e output (see Ref. 3, 

App . G) . This having been accomplished, all the remaining 
observations were averaged to form the estimated process 
vector which related the output, NORM, to the input variables, 
DMHR, DML$, DOH$ and NDAYS . 

Because of the considerably smaller number of air- 
craft data observations available it was decided to use the 
aircraft type/work types as the processes and use all data 
within those groupings. This resulted in a linear program 
that had only one choice among the processes to accomplish 
a particular output. Hence the linear program solution was 
trivial from the point of view of choosing alternative pro- 
duction plans. It does, however, provide a meaningful rela- 
tion between workload and costs. 

After the process determination was complete, the 
chosen processes were input into another program which 
prepared as output data cards in the proper format for the 
Mathematical Programming System/360 (MPS/360) linear program- 
ming (simplex) routine [3, App. K] . Also included in the 
input to the preparatory program were the penalty costs which 
Myers had computed,^ the production requirements, the resource 

^Due to a systematic error, these costs were determined to 
be incorrectly calculated. Corrected factors are listed in 
Chapter IV, Section F, of this thesis. 
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constraints, and an average labor rate. The output of the 
preparatory program was then input to the MPS/360 program for 
solution . 

4 . Role of the Model in Cost-effectiveness Analysis 

As stated earlier, it had been hoped that the linear 
economic model would have been able to provide validation for 
the results of the continuous models. Myers did expect any 
measurable decreases in input usage per unit of output to be 
evidence of an improved situation after the WIPICS installa- 
tion, or the contrary. The changes could then be associated 
with a dollar value to determine savings or cost growth. 

As only the aircraft program turned out to be of 
interest, the measures provided by the linear model would 
only be of the grossest variety due to the data limitations. 
The linear model solution provided the total cost computation 
and estimates of the process in the format of inputs per 
unit output. The total cost can be compared for the before 
and after WIPICS situations. Processes with the same output 
can also be compared for the two periods. Further validation 
can be sought from continuous analogs of the linear model, 
which follow immediately. 

E. JOB COST MODEL 

The derivation of the Daily Cost Model's relationship 
between cost and input factors highlighted some of the inde- 
pendent variables used in the present model. The formulation 
and development of the Linear Economic Model emphasized the 
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differences between the subprograms and the need to allow 
for those differences. A means for blending these important 
considerations into a continuous relationship v/as provided 
in the current model . 

1 . Formulation 

Although the Cobb-Douglas production function form 
would usually be applied to physical outputs in terms of 
physical inputs, one could approach cost flow itself, 
a priori , as the product of input cost determinants in a 
similar functional form. This model considered the output 
to be the cost flow from a given aircraft type and work 
type combination. An alternate derivation of the relation- 
ship is provided in reference 2 . Couched in terms of the 
original variables, two versions were constructed: 

Bi ^2 ^3 B, 

(1) C. = a. (P^ ) (PD ) (MIS) (NORM ) 

1 1 

, B.' b; b; b' 

(2) C. = a.'(P^ ) (NDAYS ) (MIS ) (N0W4 ) 

1 1 Jj 

where i = l,2,..-.n = number of aircraft type/work type 
combination 

NIS = average number of aircraft jobs in shop over 

the period v;hen jobs in category i were under- 
going rev/ork 

Thus n different functionsof each version are proposed 
each with its unique constant but holding a common relation- 
ship among the explanatory variables . In a hybrid of matrix 
and standard notation, the n equations can be combined for 
each version in a single function: 
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( 1 ) 



^3 ^4 

C = (Ai|^.)(P^) (PD) (NIS) (NOPPI) 

1 J_» 

^2 ®3 ®4 

(2) C = (A'4^.)(P^) (NDAYS) (NIS) (NOPJ4) 

1 XJ 

where A = (a, ,a^,...a ) 

12 n 

A' = (a' ,a ' , . . .a ' ) 

1 / n 

4/. = column vector with zeroes for all elements 
except the i^h, where a 1 is placed; that 
is, the ith canonical vector. 

The model was used to explain three different forms 

of cost, analogous to the three objective functions Nyers 

considered. For versions (1) and (2) the dependent variables 

chosen were: 

(a) TC (Total cost) = DLB$ + DML$ + DOH$ + P^NDAYS 

(b) OC (Operations cost) = DLB$ + DML$ + DOH$ 

The third form was used only with version (1) due to the 
respective definitions of the versions. 

(c) PC (Penalty cost) = P^. • NDAYS 

Work on both versions called for the raw data. Also 
required was determination of the number of all aircraft 
jobs in rev;ork on each day during the periods under consider- 
ation. Finally, a listing of daily penalty costs was neces- 
sary. Only the aircraft program was considered due to the 
exemptions of the engine program from WIPICS implementation. 

2 . Assumptions 

Basic to the structure of the model was the assumption 
that cost can be treated as a product of internal influences 
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and can be fit into the mathematical framework. The internal 



influences were portrayed, first, by P which took on the 

Li 

surrogate role of an indicator of complexity of a job. Recal- 

DT B$ 

ling that it is defined as , it was thought to respond 

well to the effect of the use of higher skilled labor on jobs 
of greater complexity. MIS, the average number of jobs in 
the shop during the rework of a given job, represented conges- 
tion within the plant. It would reflect the impact of the 
greater inefficiencies that result from increased congestion. 
It was assumed that the NARFNI v/ould not be operating in so 
low a range of MIS that there were very few jobs in shop 
and plant size inefficiencies developed. N0PJ1 provided 
information concerning the sheer size of the task to be 
accomplished . 

For version (1) , PD was used to account for the 
trend of costs to grow over time. Included in that growth 
would be inflationary effects in the materials and overhead 
contributions and the effects of age of the aircraft which 
would also be seen in materials and overhead increases. 

NOPM would probably account for any direct manhour increases 
that were the result of working on aging aircraft. For ver- 
sion (2) , NDAYS V70uld provide the alternative view of effects 
due to the amount of time an aircraft spent at NARFNI. The 
most directly affected cost would be the penalty cost, but 
this measure would also reinforce complexity effects in the 
"operational" costs. 
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The model, as pointed out in the previous section, 
assumed that production of costs was the result of common 
influences up to a multiplicative constant. This would be 
justified on the basis of the fact that, though many 
different subprograms are accomplished, the same departments 
and divisions of the plant are used across the subprogram 
mix. The constant factor would tend to "price" the aircraft 
type/work type combinations according to their relative 
materials and overhead mix characteristics. Within the 
categories, the individual jobs were considered homogeneous 
enough to justify the groupings. 

By implication, the costs predicted by the model were 
not related to a particular optimization goal within the 
NARFNI. Rather these predicted costs serve as a type of 
standard cost structure for the operation. The dependent 
variable was measured in terms of actual costs and hence 
give rise to a stochastic discrepancy. Hence the two versions 
of the model were really assumed to be represented by 

^2 ^3 ^4 e 

(1) C = (A (P^) (PD) (NIS) (NORM) 10 

e; 6' 6^ b; 

(2) C = (A i^)(Pt) (PD) (NIS) (NORM) 10 

The error terms (e and e') were assumed to arise 
from deviations from the "standard cost." Such deviations 
were assumed to be the result of greater or lesser than 
standard efficiencies gained from "non-standard" skill level 
mixes. Alternatively or additionally, any difference of 
DMHR from NORM would also be a basis for the existence of 
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the error term. Finally, the assumption of the standard 
linear model v;ere applied to the logarithmic transformation 
of the two versions above (see Thiel, ref. 7, p. 110-111). 

3 . Procedures 

In order to gain information concerning the number of 
aircraft in shop, NIS, on a given day, Trafton ' s version 
of the aircraft prorate program was used [8, App. D] . It was 
modified slightly to accomodate the entire three year range 
of data. All aircraft data cards v/ere used to obtain the 
most complete historical record possible. The output deck 
included all the aggregated prorated variables in addition 
to the desired NIS. Only the last v;as used, however, along 
with the raw data, as input to the regression program. 

Also calculated for input to the regression program 

was a revised list of penalty costs, correcting a systematic 

error in Myers' list. The final inputs were the raw data 

cards themselves separated into before and after WIPICS 

sets. A "buffer" time period of induction dates v;as excluded 

to aid in the distinction between the before and after data 

sets. The buffer was characterized by induction date before 

2 

WIPICS and production date after. 

These inputs were prepared and assembled for use 
with the regression program given as Appendix A. This 
program produced a stepwise regression, admitting each of 



2 

Due to the long time period required for aircraft rework, 
a number of the jobs included in the before WIPICS set also 
had this feature. In these cases, the majority of the produc- 
tive effort was before WIPICS. 
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3 

the explanatory variables in order. Inclusion of the sepa- 
rate categories was accomplished by creating a dummy variable 
for each. (See Theil, ref. 7, p. 155-156.) Structure of the 
model for regression then became, in general: 

C = xB+ € 

where C is an m x 1 vector of the logarithms of the 

dependent variables 

X= K Z p is an m X (n+4) matrix of dummy variables 

^ -* and logarithms of the explanatory variables 

K is an m X n submatrix such that each row contain one 
value of 1 and the rest zeros. That non- 
zero value falls in the column corresponding 
to the aircraft type/work type category. 

^ is an (n+4) x 1 vector of coefficients 

Z is an mx4 submatrix of logarithms of the explana- 
tory variables 

^ is an m X 1 vector of disturbances 
n = number of categories 
m = total number of observations 

Solution procedures proceed as described by Bradley 
[1, Chapter II,. Section B] . The regression program also 
provides the standard statistical test values. 

Regression estimates of the parameters were accomp- 
lished for both the before and after periods. The estimated 
relations were then used to predict cost values for two test 
cases drawn from the 20 categories present in both the before 
and after periods. The process was repeated for both of the 

3 

Explanatory is used here to distinguish between input 
production variables and the constants which are based on the 
categories, even though those category-related constants 
"explain," in a sense. 



47 









• OW 






>1 



t 



I 






II 



■'4 



f 



* 



( 



versions and for each dependent variable structure. Standard 
errors of the predicted total costs of all jobs in the test 
cases were computed as the mean square error. 

4 . Role of the Model in Cost-effectiveness Analysis 

The job cost model served to provide a basis for 
validation of Tye ' s results. It was thus able to overcome 
some of the weakness of the linear programming formulation. 

The model also provided its own characterization of 
the NARFNI operations in terms of cost flow. As such it 
provided the possibility of another view of the before and 
after WIPICS situation. In much the same manner as the Daily 
Production Model could be used to relate before and after 
isoproduct surfaces, this model could be used to generate 
isocost surfaces. As before, dominance of one surface by 
the other gave comparative statements a very sound base, 
while intersection of the surfaces introduced many reservations 
and limitations. 

The model did add to the body of alternatives within 
which the cost-effectiveness question can be framed. Exercise 
of those alternatives in the next section unfolds that frame- 
work . 
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IV. RESULTS OF EXERCISING MODELS 



Each of the models in the previous chapter was exercised 
using data supplied by NARFNI through its Production Perfor- 
mance Reports. General characteristics of the data base are 
presented here followed by the results of each model's usage. 
Previously reported results are presented in synopsis only. 
Though most of the models included a parallel structure for 
the engine program, only aircraft results are included in 
this chapter. 

A. DATA BASE 

A total of 837 aircraft job accounting records were 
included in the data available from the PPR. The elements 
of information were selected and transferred to computer card 
record as indicated in Appendix A of reference 6. The 
seventh field. Airframe Change Manhours, which has been 
ignored by all models was originally included on the cards 
for possible investigation. The data elements represented 
jobs inducted on or after Julian date 0069 (10 Mar 70) 
through Julian date 2332 (27 Nov 72) . Production dates of 
these jobs extended to Julian date 3066 (7 Mar 73). For 
reference, WIPICS was installed during November of 1971 and 
was operational in December 1971. 

B. DAILY PRODUCTION MODEL 

Bradley used data that began with an induction on 0069 
and ended with a production on 1235 to generate his aggregated 
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prorated statistics [1, App. A]. Near both the beginning 
and ending of this period, not all jobs in shop were included 
in the data available, and the regression was limited to the 
period corresponding to 0208 through 1153 during which time 
the job records were considered complete [1, p. 57]. 

Based on these derived observations of daily flow, he 
estimated the production relation to be [1, p. 77] : 

APH = (5 7.36) (APL) (APM) 

Standard error of exponents (0. 04 414 ) (0.01879) (.04410) 

Multiple Correlation Coefficient .9610 

Collinearity of APD with NIS and APM precluded its inclusion 
in the regression [1, p. 59 ff ] . 

Bradley attempted aggregations on weekly and monthly 
bases but found no improvement over the daily based result 
above. His work provided a basis then, for the extensions 
that followed and indicated which explanatory variables v^ere 
most effective in NARFNI production description. 

C. DAILY COST MODEL 

Trafton used the data base selected by Bradley to imple- 
ment his penalty cost extension and develop the CFS functions. 
His work, based on the Cobb-Douglas version, produced an 
estimated relation for total daily cost (equal to the sum of 
labor, material and penalty costs) with the following speci- 
fication [8, p. 34]: 
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C = (2. 64) (APH) ' (APL) (APj) 

Standard errors: (.012) (.056) (.030) 

, 2 

Multiple correlation coefficient squared, R = .960 



The CES cost function he introduced showed daily total 
cost (equal to the sum of direct labor, overhead and penalty 
costs) to be specified according to the following estimated 
relation [8, p. 30]: 

/V. 

C = (7 . 870) (P^ + AP^ (I/L) ) (APH) * 

J-i JL 

standard errors: (.006) (.149) 

/V. 

where I/L = estimate of the relation 
I/L = a (Pj^ /APj)^e^ 

D = [6 + (1-6) d/L)“P] 

6,p are estimated by simultaneous solution of 

-1 

a _ / <5 V p+1 

^ " ^ 1 - 6 ^ 



and b = 



P+1 



Multiple correlation coefficient, squared, R'^ = .988 



By these estimated cost relations, Trafton had produced 
two methods for characterizing, in dollar terms, the cost 
flow of NARFNI production efforts before WIPICS was initiated. 
Using methods he described, a similar cost flow relationship 
could be derived for the after WIPICS period. As he 
explained, test cases could then be used to compare, in 
common dollar terms, two situations that were quite different 
if described in terms of production effort. 
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D. DAILY COST MODEL, EXTENDED 

Using observations of jobs processed after WIPICS was 
installed, Tye was able to provide a characterization of that 
period for comparison as Trafton had proposed. He also had 
available additional data for the period before WIPICS to 
complement and advance that data set. Hence he was able to 
estimate an updated version of both the Cobb-Douglas and CES 
cost functions for that period. He also had over two hundred 
observations from the after WIPICS period for comparative 
estimation for the later period. 

He estimated for the Cobb-Douglas version [9, p. 36] 



C= (A) (APH)“ (APH) ^ (APP)^e^ 

2 

Coefficient Estimates R 







/N 


/s 








A 


a 


B 


Y 




Before : 


.743 


.857 


2.356 


-.094 


.949 


(Standard 


error) 


(.011) 


(.090) 


(.015) 




After ; 


.297 


.745 


4.222 


-.487 


. 876 


(Standard 


error) 


(.071) 


(1.234) 


( .066) 




For the CES 


version 


(with a 


different 


cost composition) 



estimated [9, p. 36] 

C = BIP^ + APj(I/L)] (APH)“ 
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Coefficient Estimates R 









>N 






B 


a 


3 




Before 


20.07 


.886 


-10.421 


. 852 


(Standard 


error) 


(.019) 


(.543) 




After 


8.150 


. 881 


-2.724 


.980 


(Standard 


error) 


(.016) 


(.293) 




He reported 


significance of 


the differences in 


both versions 


between the 


before 


and after 


estimates, based 


on the Chow 



test. He chose periods of time close to the changeover for 
use in the regression analysis. This was done to minimize 
the instability he noted in preliminary regressions [9, Chap- 
ter III and p. 35 ff] . 

He then used the before and after regression estimates to 
predict costs of a sample drawn from the regression construc- 
tion data. He expressed the results as total cost differen- 
tials, that is, as before WIPICS cost minus after WIPICS 
cost, a positive value indicating a less costly after WIPICS 
situation as shown in Table II below [9, p. 41]. 



TABLE II 

DIEEERENCE BETWEEN PREDICTED COSTS - AIRERAMES 







C-D 


CES 


Case 


I 


17,885 


3,306 


Case 


II 


9,241 


7,129 
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He indicated that only in the Cobb-Douglas version would the 
savings be significant with at least 90% confidence [9, p. 43]. 

It might be noted that Tye based the work on the penalty 
costs developed by Myers. Tye ' s work might be recomputed 
using the corrected penalty costs. Tye qualified the savings 
description with acknowledgement of fact that there were 
externalities not measured by the model which may have impor- 
tant explanatory capability. 

Tye's work thus represents the first comparative state- 
ment about the effect WIPICS may have had on the operation 
of the NARFNI . It was based on the general assumption of 
cost minimization subject to accomplishment of a given work- 
load. His findings presented one view of the cost flow of 
NARFNI and were subject to the next step of the procedure 
advanced by Spooner , validation . 

E. LINEAR ECONOMIC MODEL 

1 . Myers ' Results 

Myers used the before WIPICS data to generate a 
technology matrix characteristic of that period. He used 
that matrix to predict the total cost, including penalty, of 
a projected workload. He proposed that engine and aircraft 
models be checked by comparing actual costs of that workload 
after completion. This was not completed either by Myers or 
since the time he finished his work. (Myers' specific results 
are not reported; see ref. 3, p. 41 ff for details.) The 
proposed comparison between predicted and actual costs has 
been accomplished, however, in the following extension of 
his work. 
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2 . Extensions 



In order to make comparisons between the two periods 
of interest, adjustments had to be made concerning the air- 
craft type/work type groupings. As stated in Chapter II, 
cycle information for after-WIPICS and some later befora- 
WIPICS jobs was not available. This item was not reported 
among the PPR elements. It had been gained with the earlier 
before WIPICS data only by special research effort by PiSDO 
personnel, who were unable to continue due to increased 
administrative workload. As a result the second character 
of the work type in the coding scheme was ignored for all 
data. Thus, for example, F-4 aircraft undergoing PAR for 
the fourth, fifth, and sixth time would be united into one 
process instead of three separate processes as had been 
established by Myers. This action reduced the number of 
processes of the before WIPICS period from 70 to 39. Exam- 
ination was made of those individual processes which v/ere 
grouped together, and they showed sufficient homogeneity of 
NORM that the unification did not misrepresent any one 
process . 

The 837 data cards, each representing one aircraft 
job, were separated into three groups: 

1. 414 jobs before WIPICS incorporating, extending and 
filling out Myers' base 

2. 158 jobs in a buffer period 

3. 265 jobs after WIPICS 
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The buffer period consisted largely of jobs started before 
and finished after WIPICS was initiated. That period 
included all jobs with induction dates between Julian dates 
1181 and 1334 inclusive. These dates were arbitrarily chosen 
to allow for the long time period required for aircraft 
processing plus the indeterminate period while WIPICS was 
being initially tested. The before and after groups v/ere 
also used to generate the regressions used in the job cost 
model . 

The two groups were compared to determine the 20 
matching categories listed in Chapter II. Subgroupings of 
matching categories were then selected, representing 
70.4% (257/365) and 68.7% (182/265) of the original before 

and after WIPICS groups, respectively. In the interest of 
descriptive brevity, let 

{B} be the set of observations before WIPICS 

{B,,} be the subset of observations of {B} that 

M . r- 

matches the categories after WIPICS 

{a} be the set of observations after WIPICS 

{Aj^} be the subset of {A} that matches the 
categories of 

Data sets {B,,} , {A,.}, and {a} were used as input 
M M 

to Myers' Average Cost of Labor program [3, App. J], produc- 
ing average labor rates of $6.20, $6.72, and $6.74. This 
compared to $6.17 computed for (b) by Myers. Increases in 
labor rates were noted in every process although the increases 
were not of uniform proportion among the processes. Data 
sets {Bj^} and {A^^} were aggregated using Myers' Aggregation 
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Program [3, App. F] , to produce inputs for subsequent 
programs , 

Prior to use of the preparatory program, the cor- 
rected penalty costs were computed. (These are given in 
Table III, which is placed v/ith Tables IV through X at the 
end of this section.) As suggested by Trafton [8, p. 40] , 
the activity vectors were set at the actual level of NORM 
corresponding to the jobs in the sample and are listed in 
Tables VI and VII. The labor rate, process aggregations, 
penalty costs, activity vector values, and non-contraining 
resource values v/ere inputs to the MPS/360 Data Preparation 
Program [3, App. K] . This program was modified to provide 
for the set-up of three different problems corresponding 
to three different objective functions. These objective 
functions matched the variations of the Job Cost Model and 
were specified as: 

1) Min: Total Cost = [p"^T 2 + C^^T^JZ 

T 

2) Min: Operations Cost = P T 2 Z 

3) Min: Penalty Cost = c"^T 2 Z 

where symbols are defined as in Myers [3, p. 27 ff.]. 

The preparatory program provided most of the specially 
formatted input for the MFS/360 linear programming routines. 

It also produced a listing of the elements of the submatrix 

T 2 for comparison between periods. The Tp listings are 
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given in Tables IV and V. The sledgehammer of the MPS/360 
routine was then used to "execute" the "gnat" of objective 
function summation. 

The construction of the technology matrix was such 
that T^ = I , the identity matrix, for both the before and 
after situations. The T 2 and T^ matrices, however, did take 
on characteristics of the two periods. In order to use the 
models for prediction, two test cases were run against both 
the before and after models. The test cases were simply the 
two activity vectors and the two price vectors associated 
with each model. Activity and price vectors run against 
their own models simply provide actual cost determinations, 
but the runs against the opposite model represent predicted 
costs. The costs were calculated for each of the objective 
function versions and the results are listed in Tables VIII, 
IX, and X. 

The tables of comparative values are of the follow- 
ing format: 






Before WIPICS Model After WIPICS Model 



Actual Cost of 


Predicted Cost of 


Predicted Cost of 


Actual Cost of 
M 
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All figures represent millions of dollars. The upper right 
corner prediction of Table VIII, for example, is read, "If 
the jobs represented by had been accomplished during the 

after WIPICS period, it is predicted that the total cost 
would have been $51,498 million." Dollar amounts may be 
compared horizontally, but not verically, since the data sets 
are quite different in size and composition. 

As the comparative results indicate, the after 
WIPICS period costs were estimated to be higher in each of 
the cost variations used. Comparison of entries in the T 2 
matrices for before and after situations emphasized the 
increases in resources used per hour of NORM. In every 
process at least one coefficient was higher for the after 
WIPICS period, with many cases showing two and three increased 
coefficients. Any decreases were relatively smaller in magni- 
tude than the increases. This model contains no inherent 
inflation compensation for the materials and overhead expen- 
ditures such as the DMHR price has . 

Comparing- the activity vectars in Tables VI and VII 
highlighted another potential problem. The two vectors 
presented radically different levels of activity in many of 
the processes. Such differences could greatly magnify any 
deviation of the linear relation from, the true relationship, 
which is more probably non-linear. Possibly the linear 
estimates were pushed too far beyond their usefulness. 

The linear model results provided a sharp contrast 
to the results of the daily cost model. Hence it did not 
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serve to validate that model. Neither did the linear model 



refute the daily cost model, but it did introduce well 
founded doubt. This nebulous situation would provide addi- 
tional cause to seek another validation method. The follow- 
ing model was developed for that use. 



TABLE III 

CORRECTED PENALTY COSTS 



Aircraft Program 



Type 

Aircraft 


Unit 

Cost 


Service Life 
(months ) 


Penalty Costs 
($/day in shop) 


C-2A 


$10,742,000 


105 


3410.15 


E-2B 


10,742,000 


105 


3410.15 


F-4B 


2,756,000 


80 


1148.33 


RF-4B 


2,699,000 


96 


937.15 


F-4J 


2,492,000 


80 


1038.23 


RF-8G 


1,300,000 


75 


577.72 


F-8H 


1,352,000 


54 


834.48 


F-8J 


1,302,000 


54 


803.62 


RF-3A 


1,508,000 


80 


628.27 


SH-3A 


1,278,000 


80 


532.45 


SH-3D 


1,064,000 


80 


443.29 


CH-46A 


1,083,000 


80 


451.20 


UH-46A 


834,000 


80 


347.47 


CH-46D 


1,083,000 


80 


451.20 


UH-46D 


834,000 


80 


347.47 


CH-46F 


1,083,000 


80 


451.20 


CH-53A 


1,453,000 


96 


504.46 


CH-53D 


1,453,000 


96 


504.46 
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TABLF IV 

BEFORE WIPICS LINFAR MODEL MATRIX VALUES 



PROCESS 


CBJ FCN 
TOTAL COST 




R1 ROW 


R2 ROW 


R3 ROW 


1 


50.8837 




1 .0033 


2.6083 


6.1787 


2 


25. 3226 




1 .0o58 


2.7924 


6 .98 14 


•a 


23.7328 




1 . 0233 


1.4353 


6.4288 


4 


23 .40 82 




1 .0375 


2. 1636 


6.4856 


5 


24.7885 




1 . 0476 


1.9794 


6.A993 


6 


26.2025 




1.0709 


2.3736 


6.5446 


7 


23.8285 




1.0117 


2 .5836 


6 .4357 


8 


25.5976 




1 . 0907 


2. 9067 


6.5343 


9 


19.9475 




1.0135 


1.6247 


6.6520 


10 


23. 51 80 




1 .1885 


2 .5320 


7.1241 


11 


19. 6264 




0.8193 


2.1192 


5.5877 


12 


20.7446 




0 .9599 


2.1615 


6.0713 


13 


20.4524 




0. 9621 


2.3180 


6.4492 


14 


22. 0935 




1.0129 


3.2470 


6.3631 


15 


20.11 10 




0.8567 


3.0531 


5.6263 


16 


26. 0542 




1. 0788 


4. 8596 


7.5501 


17 


2 1.7725 




0.9254 


5.3453 


6.2415 


18 


22.9244 




1 .0350 


4.5450 


6.1227 


19 


19. 9200 




0.9633 


3. 1309 


5.9558 


20 


20.5787 




1 .0 183 


3 . 1359 


6.6616 


R 1, R2, R3 


RCWS ARE ROWS 


OF T2 






R1 VALUES 


- EXPENDED 


MANHOURS PER HOUR OF NORM 


R2 VALUES 


- EXPENDED 


MATERIAL 1 


PER HOUR OF 


NORM 


R3 VALUES 


- EXPENDED 


OVERHEAD $ 


PER HCUR CF 


NORM 


ONLY THE 


OBJECTIVE FUNCTION ROW 


VECTOR CHANGES FOR 


OPERATIONS AND PENALTY 


COST MODELS, AS SHOWN BELOW 



OBJ FCN 




OBJ FCN 


CPEPATIONS COST 




PENALTY COST 


15.0000 


1 


35. 8700 


. 16.3800 


2 


8.9400 


14. 20C0 


3 


9. 5200 


15.0800 


4 


8.3200 


14.9700 


5 


9.8100 


15. 5500 


6 


10. 6400 


15.2900 


7 


8.5300 


16.2000 


8 


9.3900 


14.56C0 


9 


5. 3800 


17.0200 


10 


6.4900 


12.7500 


11 


6.3300 


14. 1800 


12 


6. 5600 


14.7300 


13 


5.7200 


15.8900 


14 


6.2000 


13.9900 


15 


6. 1200 


19.0900 


16 


6.9500 


17.32 00 


17 


4.4400 


17. 08C0 


18 


5. 8300 


15.0500 


19 


4. 8600 


16. 1100 


20 


4.4600 
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TABLF V 

AFTER WIPICS LINEAR MODEL MATRIX VALUES 



PROCESS 


OBJ FCN 




R1 ROW 


R2 ROW 




R3 ROW 




TCTAL COST 












1 


54.0431 




0.9347 


3.7940 




6.8082 


2 


27.2283 




1.1166 


2 .1293 




7 .7364 


2 


27. 6738 




1.0950 


1 . 9956 




7.9110 


4 


24.2239 




1 .0250 


2.2246 




7.243 1 


5 


29. 1293 




1 .1292 


2.1919 




7 .9766 


6 


30.2740 




1.1186 


2.3613 




7.7940 


7 


29.3154 




1 .0234 


4.1372 




7.3677 


8 


24.4796 




0.9739 


2 .6037 




6 .8329 


9 


16. 15 29 




0.6425 


1. 3869 




4.4964 


10 


19.57 13 




0 .9 129 


1.9015 




6.4321 


11 


26. 1976 




1.0280 


4.3435 




7.5144 


12 


24.4091 




0.9033 


5 . 3909 




6.3861 


13 


28. 6139 




1 .0921 


6 .4555 




7 .2433 


14 


27.8638 




1 . 1078 


4. 8085 




8. 1890 


15 


28.3191 




1 . 1423 


4.2452 




8.0236 


16 


26. 1638 




1.0177 


5.2367 




7 .6349 


17 


25.50 25 




1.0644 


4. 7743 




7. 1854 


18 


22 .8347 




0 .8822 


4.8571 




6.^737 


19 


22.9092 




0.9539 


3.9050 




5.9969 


20 


23.7676 




0.9 147 


4.9925 




6.9606 


R 1 , R 2 , R 2 


RCNS ARE ROa 


!S 


OF I 2 








R1 VALUES 


- EXPENDED 


MANHOURS PER HOUR OF 


NORM 


R2 VALUES 


- EXPENDED 


MATERIAL $ 


PER HOUR 


CF 


NORM 


R3 VALUES 


- EXPENDED 


OVERHEAD $ 


PER HCUR 


CF 


NORM 


ONLY THE 


OBJECTIVE FUNCTION ROV>l 


VECTOR CHANGES FOR 


OPERATIONS AND PENALTY 


COST MODELS, AS SHOWN BELOW 



OBJ FCN 




□BJ FCN 


OPERATIONS COST 




PENALTY COST 


16. 8800 


1 


37. 1500 


. 17.3600 


2 


9.8500 


17.2600 


3 


10.4000 


16.3500 


4 


7. 3600 


17.7500 


5 


11.3700 


17. 6700 


6 


12.6000 


18.3800 


7 


10. 9300 


15.9600 


8 


8.4900 


10.2000 


9 


5.9500 


14.4600 


10 


5. 1000 


18.7700 


11 


7.4200 


17. 8400 


12 


6. 5600 


21.0300 


13 


7. 5700 


20.4400 


14 


7.4200 


19.9500 


15 


8. 3600 


19.7 100 


16 


6.4500 


19. 1 LOO 


17 


6 .3300 


17.2500 


18 


5. 5700 


17.3 100 


19 


5.5900 


18.1000 


20 


5 .6600 
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TABLF VI 



BEFORE WIPICS ACTIVITY 
(BEFORE WIPICS) 



PROCESS 

1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 



ACTIVITY 

26900 . 
374990 . 
260440 . 
10600. 
278240 . 

84900. 
149300. 
71600 . 
31100. 
62100. 
8800. 
223100. 
2 1000 . 
44000 . 
99300 . 
34300. 
1 18500 . 
16500 . 
5500. 
7000. 



VECTOR 



LEVEL 

00 

00 

CO 

00 

00 

00 

00 

00 

00 

00 

00 

00 

00 

00 

00 

CO 

00 

00 

CO 

00 



TABLF VII 

AFTER WIPICS ACTIVITY VECTOR 



OCESS 


(AFTER WIPICS) 

ACTIVITY LEVEL 


1 


50200.00 


2 


251400 .00 


3 


121100.00 


4 


106100.00 


5 


489300 .00 


6 


89300.00 


7 


17200.00 


8 


31300.00 


9 


9900.00 


10 


12000.00 


11 


19500.00 


12 


35700. CO 


13 


8600.00 


14 


95610.00 


15 


56600.00 


16 


22200. CO 


17 


48000.00 


18 


17100.00 


19 


87600.00 


20 


57500.00 
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TABLE VIII 



LINEAR MODEL RESULTS - TOTAL COST 



Base 



Cases 


Before WIPICS Model 


After WIPICS Model 


M 


46.192 


51.498 




40.799 


45.565 



(millions of dollars) 



Base 



TABLE IX 

LINEAR MODEL RESULTS - OPERATIONS COST 



Cases 


Before WIPICS Model 


After WIPICS Model 




29.708 


33.043 




25.882 


28.972 



(millions of dollars) 



TABLE X 

LINEAR MODEL RESULTS - PENALTY COST 

Base 



Cases 


Before WIPICS 


After WIPICS 




16.484 


18.455 




14.917 


16.693 



(millions of dollars) 
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F. JOB COST MODEL 

1 . Preparation 

Trafton's proration program was modified to accommo- 
date a time span of 1100 days and was used to produce a card 
record that included NIS data. The complete set of 837 data 
cards was used to provide as complete a record as possible 
of the variable NIS. The usual "tails" appeared and decision 
was made to define the usable period as that period between 
the first and last occurrence of 60 jobs in shop. This 
provided cutoff dates of 0187 and 2272 respectively. For 
the regressions, any jobs falling outside of that interval 
were ignored. Data sets {b} and {a} were assembled as 
described previously to be used for the regressions. The 
corrected penalty costs were used in this model, as listed 
in Table III. These inputs were then run with the regression 
program given in Appendix A. The program provided simul- 
taneous regression and prediction results, but these have 
been separated in what follows for the purposes of discussion. 

2 . Regression 

The program used for regression analysis calculated 
the estimates using logarithms of base 10. The program 
established dummy variables for each different category 
encountered. In the models based on the before WIPICS situa- 
tion 36 dummy variables were generated compared to 37 for the 
after WIPICS situation. As noted in Chapter II, there were 
20 categories common to the two periods and all twenty 
entered the regression base. The possibility existed that a 
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the variation in their dependent variables. The standard 
errors of the dependent variables were also consistently 
low which indicated that the functions provided a good fit 
to the actual data. 

Between the tv;o versions on the comparable cost 
definitions, the estimated relationships of version 2 showed 
better measures of variation accountability and fit than did 
the counterparts in version 1, except in the after WIPICS 
operations cost functions, where there was almost parity. 
Recall the version 2 models use NDAYS in lieu of PD in the 
explanatory structure. Such was not unexpected since the 
duration of time spent in rework would be more likely to 
explain cost than a trend - ceteris paribus , as they v^7ere in 
this comparison. 

Another measure of model accuracy included in the 
tables is analogous to what Tye referred to as "percent 
error in cost" [9, p. 29]. This measure is the standard 
error to mean ratio (SF/M) and is defined: 



• 


^ - 2 






/ E [C.-C. P 




A 


/ i=l ^ ^ 




\ 


^ m 


1 




\/ m 


ECj,/m 







2\1 


Z tCi-Cil^ 

1=1 



EC. 

1 



where = predicted cost of job i. 

The models of Penalty Cost separated out this imputed 
measure and suggested some possible explanations. In both 
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before and after WIPICS situations, the NIS variables entered 
with negative exponents as was true in the other cost varia- 
tions of version 1. Recall that Trafton and Tye reported 
similar results for the companion AP^. Rather than indicating 
purely congestive effects this variable probably portrayed 
the effects of job flow pressure. A job inducted and 
reworked during a period of lower density (lower NIS) was 
probably not expedited to the degree those of higher density 
times were. Hence its overall stay at NAPJ’NI may have 
lengthened, increasing the penalty cost. The management adage, 
"Work expands to fill the time allotted," may also apply to 
this particular industrial operation. 

Between the two penalty cost models there v;as also 
a shift of explanatory power of the variables. The before 
WIPICS model showed the influence of the trend factor PD, 
while its coefficient in the after WIPICS model is not 
significantly different from zero. An examination of the 
sequential values of NIS, recorded by the prorate program, 
confirmed a distinct upward trend in NIS over the period 
before WIPICS was installed and a level pattern during the 
after WIPICS period. The results were then consistent; as 
the workload increased to the after WIPICS level, the PD had 
no trend to indicate and NIS reflected that the "pressures" 
had more relative impact on cost. Further, the Operations 
Cost functions of version 1 show that both before and after 
WIPICS estimates of the NIS coefficient are not significantly 
different from zero. Hence, from the operational viewpoint, 
NIS did not seem to reflect congestive effects, either. 
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In the Total Cost models of version 1, there V 7 as a 
dramatic shift in the importance of the explanatory variables. 
The before WIPICS model indicated greater diversity among 
the job categories as demonstrated by the values of the 
dummy variable coefficients. In the after WIPICS model, 
the explanatory variables took a greater role and indicated 
more commonality of the job categories as shown by smaller 
variations in the dummy coefficients. The influence of NIS 
on penalty cost contributed to its entry into this model; 
whereas NIS did not enter the before WIPICS model. 

Concerning the models of version 2, comparison of 
the Operations Cost to Total Cost showed the relative changes 
in role between NORM and NDAYS for both time periods. The 
Operations Cost was more NORM-dependent while the Total Cost 
showed the effect of adding the penalty by the increased 
relative importance there of NDAYS. The difference in the 
definitions of the alternatives provided that expected 
result . 

More dramatic and not expected was the change across 
time periods in the sign of the coefficients of NIS. VThile 
this happened in both Total and Operations Cost models it 
was most pronounced in the latter. In these models the 
combination of NDAYS and NIS should actually provide a 
measure of congestion. One possible explanation was con- 
sidered: If WIPICS had been effective there would be reason 

to believe that congestion would no longer influence the 
productive processes and costs generated there. The estimated 
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equation for the after WIPICS period did not include a signi- 



ficant coefficient for NDAYS, which would render NIS more 
indicative of pressure than congestion. 

3 . Prediction 
a . General 

The base cases {B.,} and {A..} used in the linear 

M M 

models v/ere also used to predict costs in each of the 10 

models . The base cases contained observations which had only 

the elements necessary for specifying three of the four 

explanatory variables: 1101^4 (directly), P^. (DML$/DMHR) , and 

PD (directly) or NDAYS (PD-IND) . The appropriate value of 

NIS was generated by the program if the observation met the 

criteria used for the regression observations. However, 

those falling partly or wholly in the "tail" periods v/ere 

assigned an NIS value equal to the overall average value 

of the complete before or after period from which they were 

taken. The average number in shop for the before WIPICS 

period, 0187 through 1364, was 87 jobs. For the after WIPICS 

4 

period of 1335 through 2272 this average was 97 jobs. This 
procedure, while improper for regression, is not an undue 
extrapolation for prediction and was done to insure that all 
observations of {B,,} and {A.,} were included. Better compar- 
ability with the linear model was expected under such rules. 



^The time period overlap v/as intentional. This was done 
to include the effect of those few before wpiCS jobs of 
great length that were still in process until the year end. 
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TABLE XI 

VERSION 1 BEFORE WIPICS TOTAL COST 

SUM OF DEPENDENT VARIABLE VALUES IS 0.7979D 08 
SUM OF PREDICTED DEPENDENT VARIABLES IS C.7925D 08 



STANDARD 
MEAN IS C 


ERROR TO MEAN 
.2254D 06 


RATIO IS 


0. 1402D-0 1 




SOURCE 


ANALYSIS OF 
SUM OF SQUARES OF 


VARIANCE 

MEAN SQUARE 


F STATISTIC 


TSS 


0.9842D 04 


354 


0.2780D 02 




RDM 


0.9815D 04 


1 


0.9815D 04 


54 5 ’: * 


TSSA 


0.2666D 02 


353 


0.7553D-01 




RDB 


0.984 ID 04 


40 


0.2460D 03 




RDBA 


0.2599D 02 


39 


0.6663D 00 


309.2749 


ERROR 


0.6765D 00 


314 


0.2 L54D-02 




RSCR IS 


0.9746D 00 


RSQR ADJUSTED IS 0.9715D 00 


THE STANDARD ERROR OF 


THE DEPENDENT VARIABLE 


IS 0.4642D-01 


VARIABLE 


COEFFICIENT 


STD ERROR T STATISTIC 


1 

2 

3 

A 


0 . 1326D 00 
C.2003D 00 
-0.3728D 00 
0.3557D 00 


0 .76460 
0.3L51D 
0.3395D 
0 .2256D- 


-01 0.1734D 

-01 0.6355D 

OC -0.1098D 
-01 0.1576D 


01 

01 

01 

02 



On Tables XI through XX, asterisks indicate an F statistic 
value greater than 100,000. 
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TABLE XII 



VERSION 1 AFTER WIPICS TOTAL COST 

SUN CF DEPENDENT VARIABLE VALUES IS 0.45160 08 

SUM OF PREDICTED DEPENDENT VARIABLES IS C.4504D 08 

STANDARD ERROR TO MEAN RATIO IS 0.14L5D-01 
MEAN IS 0.2340D 06 



ANALYSIS CF VARIANCE 

SOURCE SUM OF SQUARES DF MEAN SQUARE F STATISTIC 



TSS 


0.543 ID 


04 


193 


0.2814D 


02 




RDM 


0.5420D 


04 


1 


0.5420D 


04 


3{c 


TSSA 


0. 112 5D 


02 


192 


0. 5859D- 


•01 




RDB 


0.543 ID 


04 


41 


0.1325D 


03 


98676.8894 


RDBA 


0. 11C5D 


02 


40 


0.2761D 


00 


205.6978 


ERROR 


0.204CD 


00 


152 


0. 1342D- 


■02 




RSCR IS 


0.9819D 00 


RSQR 


ADJUSTED IS 


0 . 


9771D 00 



THE STANDARD ERROR OF THE DEPENDENT VARIABLE IS 0.3664D-01 



VARIABLE COEFFICIENT 



STD ERROR T STATISTIC 



1 

2 

3 

4 



0.2567D 00 
C.2804D OC 
-C.5996D 00 
0.8653D 00 



0.51770-01 
0.1614D 00 
0.232 10 OC 
0 .6932D-01 



0.6891D 01 
0,1737C 01 
-0.2584D Cl 
C.1248D 02 
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TABLF XIII 

VERSION I BEFORE WIPICS OPNS COST 

SUF OF DEPENDENT VARIABLE VALUES IS 0.4689D 08 

SUN OF PREDICTED DEPENDENT VARIABLES IS 0.4659D 08 

STANDARD ERROR TO MEAN RATIO IS 0.12A9D-CI 
MEAN IS 0.1325D 06 



ANALYSIS OF VARIANCE 



SOURCE 


SUM OF SQUARES 


DF 


MEAN SQUARE 


F STATIST 


TSS 


0.9099D 


04 


354 


0.2570D 02 




RDM 


0.9081D 


04 


1 


0.908 ID 04 




TSSA 


0. 1827D 


02 


353 ■ 


0.5176D-01 




RDB 


0.9098D 


04 


40 


0.2275D 02 


98728.8696 


RDBA 


0.1755D 


02 


39 


0.4499D 00 


195 .2932 


ERROR 


0.72340 


CO 


314 


0.23040-02 




RSCR IS 


0.96040 00 


i RSQR 


ADJUSTED IS 0.9555D 00 



THE STANDARD ERROR OF THE DEPENDENT VARIABLE IS 0.A800D-0L 



VARIABLE 

1 

2 
3 
A 



COEFFICIENT 

0.2345D 00 
0.1743D 00 
-0.1546D 00 
0.39L9D 00 



STD ERROR T STATISTIC 

O.TOOTD'Ol 0.29660 01 
0.3258D-01 0.3350D 01 
0.351CD 00 -C.44C3D 00 
0.2333D-01 0.L680D 02 
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TABLF XIV 

VERSION 1 AFTER WIPICS QPNS COST 

SUP. OF DEPENDENT VARIABLE VALUES IS 0 .2752D 08 

SUM GF PREDICTED DEPENDENT VARIABLES IS 0.2744D 08 

STANDARD ERROR TO MEAN RATIO IS 0.1146D-0L 
MEAN IS 0.1426D 06 



ANALYSIS OF VARIANCE 



SOURCE 


SUM OF SQUARES 


DF 


MEAN SQUARE 


F STATISTIC 


TSS 


0.5050D 


04 


193 


0.2617D 02 




RDM 


0.5043D 


04 


1 


0.5043D 04 




TSSA 


0.7207D 


OL 


192 


0. 3754D-01 




RDB 


0.50500 


04 


41 


0.1232D 03 


76238.7354 


RDBA 


0.69620 


01 


40 


0.1740D 00 


107.7305 


ERRCR 


0.2456D 


CO 


152 


0. 16 16D-0 2 




RSQR IS 


0.9659D 00 


RSQR 


ADJUS 


TED IS 0 .95700 00 


THE STANDARD ERROR OF THE 


DEPENDENT VARIABLE 


IS 0.4C19D-01 



VARIABLE 


COEFFICIENT 


STD ERROR 


T 


STATISTIC 


1 


0.5886D 


00 


0.5679D-01 


0 


.10360 


02 


2 


C. 3569D 


00 


0.1771D 00 


0 


.20150 


01 


3 


-0.3963D 


00 


0.25A6D 00 


-0 


. 1557D 


01 


4 


0.10100 


01 


0.7604D-01 


0 


. 1328D 


02 
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TABLE XV 



VERSION 1 BEFORE WIPICS PENALTY COST 



SUP OF DEPENDENT VARIABLE VALUES IS 0.3290C 08 
SUM CF PPECICTED DEPENDENT VARIABLES IS C.3251D 08 



STANDARD 


ERROR TO MEAN 


RATIO IS 


0.2182D-01 




MEAN IS 0 


.9293D 05 














ANALYSIS OF 


VARIANCE 




SOURCE 


SUM OF SQUARES DF 


MEAN SQUARE 


F STATIST 


7SS 


0. 8223D 


04 


354 


0.2323D 02 




RDM 


0.8178D 


C4 


1 


0.8178D 04 


^ 


7SSA 


0.4563D 


02 


353 


0.1293D 00 




RDB 


0.8222D 


04 


40 


0.2056D 03 


5141 8.C761 


RDBA 


0 .4438D 


02 


39 


0. 1138D 0 1 


284.6449 


ERROR 


0.1255D 


01 


314 


0.3998D-02 




RSQR IS 


0.9725D 00 


RSQR ADJUSTED IS 0.9691D 00 


THE STANDARD ERROR 


OF 


THE DEPENDENT VARIABLE 


IS 0.6323D 


VARIABLE 


CCEFFIC lENT 


STD ERROR T STATISTIC 


1 


-C.2420D- 


Cl 


0. 1042D 


00 -0.2323D 


00 


2 


0 .24 L9D 


00 


0 .4292D- 


•01 0.5635D 


01 


3 


-C.9253D 


00 


0 .4624D 


00 -0.2001D 


01 


A 


0.2919D 


OC 


0.30730-01 0.9496D 


01 
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TABLE XVI 



VERSION 1 AFTER WIPICS PENALTY COST 

SUK OF DEPENDENT VARIABLE VALLES IS 0.176AD 08 

SUN CF PREDICTED DEPENDENT VARIABLES IS 0.1751D 08 

STANDARD ERROR TO MEAN RATIO IS 0.288AD-01 
MEAN IS 0.9142D 05 



SOURCE 



SUM OF SQUARES 



ANALYSIS OF VARIANCE 

MEAN SQUARE 



OF 



F statistic 



TSS 


C.4494D 


C4 


193 


0.2329D 


02 


RDM 


0.4473D 


C4 


1 


0.4473D 




TSSA 


0.2181D 


02 


192 


0 .1136D 


00 


RDB 


C.4494D 


C4 


41 


0. 1096D 


03 31821.1321 


RD6A 


0.2L29D 


02 


40 


0.5322D 


00 154.51S7 


ERROR 


0.5236D 


00 


152 


0.3444D- 


■02 


RSQR IS 


0.9760D C 


0 R 


SGR ADJUSTED IS 


0.9697D 00 



THE 


STANDARD ERROR 


OF 


THE DEPENDENT 


VARIABLE 


IS 


VAR 


I ABLE 


CCEFFICIE 


NT 


STD ERROR 


T STATISTIC 




1 


-C.8250D- 


Cl 


0. 8292D-01 


-C.995CD 


CO 




2 


-0.10 18D 


00 


0.2586D 00 


-0.3938D 


GO 




3 


-0. 1459D 


01 


0.3717D 00 


-0.3924D 


01 




4 


0.5933D 


00 


O.lllOD CO 


0. 5343D 


01 



0.58L9D-01 
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TABLF XVII 



VERSION 2 BEFORE WIPICS TOTAL COST 

SUf' CF DEPENDENT VARIABLE VALUES IS 0.7979C 08 

SUM CF PREDICTED DEPENDENT VARIABLES IS 0.7961D 08 

STANDARD ERRCR TO MEAN PATIO IS 0.6544D-02 
MEAN IS 0.2254D 06 



ANALYSIS OF VARIANCE 



SOURCE 


SUM OF SQUARES 


OF 


MEAN 


SQUARE F STATISTIC 


TSS 


C.9842D 


04 


354 


0.2780D 


02 


RDM 


C.9815D 


C4 


1 


0.9815D 




TSSA 


0.2666D 


02 


353 


0.7552D- 


-0 1 


RDB 


0.98420 


04 


40 


0.2460D 


Q2 si ^}r jjt :4i * 


RDBA 


0.2639D 


02 


39 


C. 6767D 


00 785.6038 


ERROR 


0.2705D 


00 


314 


0.8614D- 


-03 


RSGR IS 


0.9899D OC 


1 RSQR 


ADJUSTED IS 


0.9886D 00 



THE STANDARD ERROR OF THE DEPENDENT VARIABLE IS 0.2925D-01 



VARIABLE 

1 

2 

3 

4 



COEFFIC lENT 

0.1571D 00 
0.5972D 00 
0.6067D 00 
C.1922D 00 



STD ERROR 

0.4822D-01 
0. 2496D-01 
0. 1529D 00 
0. 1613D-0I 



T STATISTIC 

0.3257D 01 
0.2292D 02 
0.3968D 01 
0.1192D 02 
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TABLE XVIII 

VERSION 2 AFTER InIPICS TOTAL COST 

SUf' CF DEPENDENT VARIABLE VALUES IS 0.4516D 08 

SUN OF PREDICTED DEPENDENT VARIABLES IS 0.4509D 08 

STANDARD ERROR TO MEAN RATIO IS C.9098D-C2 
MEAN IS 0.2340D 06 



ANALYSIS CF VARIANCE 



SOURCE 


SUM OF SQUARES 


DF 


MEAN SQUARE 


F STATIST 


TSS 


C. 543 ID 


C4 


193 


0.2814D 02 




RDM 


0.542CD 


04 


1 


0.5420D 04 




TSSA 


C.1125D 


02 


192 


0 .5859D-0 1 




RDB 


0.543 ID 


C4 


41 


0. 1325D 03 




RDEA 


0. ILL ID 


02 


40 


0.2777D 00 


296.2273 


ERROR 


0. 1425D 


00 


152 


0.9373D-03 




RSQR IS 


0.9873D CO RSQR 


ADJUSTED IS 0.9840D 00 


THE STANDARD ERROR 


OF THE 


DEPENDENT VARIABLE 


IS 0.3C62D 



VARIABLE 


COEFFICIENT 


STD ERROR 


T STATISTIC 


1 


C.40C4D 


CC 


C. 4297D-C1 


0.9317D 


Cl 


2 


0.35390 


00 


0 .42290-01 


0. 8367D 


01 


3 


-C.4402D 


00 


0.1331D OC 


-0.3307D 


01 


4 


0.6656D 


CC 


0. 6292D-C1 


C. 1058D 


02 
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TABLE XIX 

VERSION 2 BEFORE WIPICS 



OPNS COST 



SUP CF DEPENDENT VARIABLE VALLES IS 0.468SD C8 

SUP OF PREDICTED DEPENDENT VARIABLES IS 0.4667D 08 

STANDARD ERRCR TO PEAN RATIO IS 0.1077D-CI 
MEAN IS C. 1225D 06 



SOURCE 



SUM OF SQUARES 



ANALYSIS OF VARIANCE 



CF 



MEAN SQUARE F STATISTIC 



TSS 


0.9099D 


04 


354 


0. 2570D 


02 




RDP 


0.9081D 


04 


1 


0 .908 ID 


04 




TSSA 


C. 1827D 


C2 


353 


C.5176D- 


■01 




RDB 


0.9098D 


04 


40 


0.2275D 


03 


jf; 


RDBA 


0.1767D 


02 


39 


0 .4530D 


00 


236.0674 


ERROR 


0.6026D 


00 


314 


0. 1919D- 


02 




RSQR IS 


0.9670D 00 




RSQR ADJUS 


TED IS 


0 . 


9629D 00 



THE STANDARD ERROR OF THE DEPENDENT VARIABLE IS 0.4381D-0L 



VARI ABLE 


CCEFFICIE 


NT 


1 


0 .2588D 


00 


2 


0.3676D 


00 


3 


C.8390D 


OC 


4 


0.3013D 


00 



STD ERROR 

0 .7 197D-0 1 
0.3726D-01 
0.2282D 00 
0.2407D-01 



T STATISTIC 

0.35F5D 01 
0 .9865D OL 
C.3677D Cl 
0.1252D 02 
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TABLE XX 

VERSION 2 AFTER UIPICS CPNS CCST 

SUM OF DEPENDENT VARIABLE VALUES IS 0.2752D 08 

SUM CF PPECICTED DEPENDENT VARIABLES IS 0.2744D 08 

STANDARD ERROR TO MEAN RATIO IS 0. 1150D-C1 
MEAN IS 0.1A26D 06 



ANALYSI S OF VARIANCE 



SOURCE 


SUM OF SQUARES 


DF 


MEAN SQUARE 


F STATISTIC 


TSS 


C.505CD 


C4 


193 


0.2617D 02 




RDM 


0.5043D 


C4 


1 


0.5043D 04 


Axe 


TSSA 


C.7207D 


OL 


192 


0 .3754D-0 1 




RDB 


C.505CD 


C4 


41 


0. 1232D 03 


74357.6377 


RDBA 


0 .6956D 


01 


40 


0.1739D 00 


104.9788 


ERROR 


0.2518D 


00 


152 


0.1656D-02 




RSQR IS 


0.9651D CO 


RSQR 


ADJUSTED IS 0.9559D 00 


THE STAN 


CARD ERROR OF THE 


DEPENDENT VARIABLE 


IS 0.4070D-01 



VARIABLE 


COEFFICIENT 


STD ERROR 


T STATISTIC 


1 


C.6072D CC 


0. 5713D-01 


C. 1063C 


02 


2 


0.2585D-01 


0 .5622D-01 


0.4597D 


00 


3 


-C.7639D 00 


0.1769D 00 


-0 .43 17C 


01 


4 


C.1006D 01 


0. 3364D-01 


0. 1203D 


C2 
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The program produced predicted costs for each job, 
and then these costs were summed over the entire base cases. 
Each of the 10 separate models predicted two costs, one for 
and another for The results are given in Tables 

XXI through XXV. Costs are in millions of dollars, arranged 
according to Figure 3 below. 



Base 
Case : 




} 



M 



Before WIPICS Model After WIPICS Model Actual Cost 



Predicted (B^, } 

M 

Cost 

(Standard Error) 


Predicted (B ) 
Cost 

(Standard Error) 


Aggregate Cost 
of the jobs in 
base case {b^} 


Predicted iA^ ) 
Cost ^ 

(Standard Error) 


Predicted } 

Cost 

(Standard Error) 


Aggregate Cost 
of the jobs in 
base case (Am) 



Figure 3. Model Predictions. 



Standard errors reported are the standard errors of estimates 
of the mean of the aggregated base case costs in dollar terms 
as opposed to that which could be computed based on the loga- 
rithmic form of the data. That is, the standard error was 
defined as: 



SE = 



Z[Ci-Ci] 



m 



The tables are read, taking the upper right corner of Table 
XXI for example, "If jobs had been reworked during the 

after WIPICS period the aggregate cost would have been $41.25 
million. " 

It appeared that the version 2 models did do a better 
job of predicting the actual costs of the base cases 
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corresponding to the periods from which the models were esti- 
mated than their counterparts in version 1, 

b. Version 1 

As shown in Table XXI, the before WIPICS Total 
Cost was predicted to be higher for both cases. Predictions 
for case not significantly different. In Table XXII, 

the case was again predicted to be higher in Operations 

Cost in the before WIPICS environment, v/hile case showed 

the opposite result. 'T’able XXIII depicting the Penalty Cost, 
reversed the pattern of the Operations Cost comparisons. If 
the Penalty Cost and Operations Cost tables were added, they 
would show parity for case (Aj^} and higher after WIPICS 
predictions for 

c. Version 2 

In Tables XXIV and XXV both Total and Operations 
Cost predictions for the base case ^Bj^} indicated less cost 
in the before WIPICS period. However, the base case 
showed the opposite result for both Total and Operations 
Cost, predicting that the after WIPICS period would be less 
costly. If the actual penalty costs for each base case v;ere 
added to the predicted Operations Costs, the Total Cost 
results would be repeated as expected due to the computation 
of the penalty cost. 



81 



Tiol 
< oril 

•»(ti 
1^1 V «1 
•*l wtf 
^fliow 



JacO 
^ ttl 
■jworta 
ittoO 



TABLF XXI 



VFRSION 1, TOTAL COST, COMPARISONS 



Base Case 


Before WIPICS Model 


After WIPICS Model 


Actual Cost 


tv 


44.91 

(.0248) 


41.25 

(.0362) 


46.19 




43.72 

(.0546) 


43.66 

(.0475) 


45.58 



(millions of dollars) 



TABLF XXII 

VERSION 1, OPERATIONS COST, COMPARISONS 
Base Case Before WIPICS Model After WIPICS Model Actual Cost 



M 


28.95 

(.0156) 


23 .68 
(.0316) 


29.71 




27.81 


28.17 










28.88 


M 


(.0243) 


(.0166) 





(millions of dolars) 



TABLE XXIII 

VFRSION 1, PENALTY COST, COMPARISONS 



Base Case Before WIPICS Model 


After Wipics 


Model 


Actual Cost 




15.87 

(.0130) 


24 . 55 
(.0374) 




16.48 




15.49 

(.0425) 


15.22 

(.0463) 




16.70 



(millions of dollars) 
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TABLE XXIV 



VERSION 2, TOTAL COST, COMPARISONS 
Base Case Before WIPICS Model After WIPICS Model Actual Cost 






<Ai> 



46.13 

(.0112) 


50.62 

(.0256) 


46.19 


45.97 


44.12 








45.58 


(.0271) 


(.0299) 





(millions of dollars) 



TABLE XXV 

VERSION 2, OPERATIONS COST, COMPARISONS 



Base Case 






'A,’ 



Before WIPICS Model After WIPICS Model Actual Cost 



29.59 

(.0111) 


34.87 

(.0274) 


29.71 


■ 28.98 


27.82 








28.88 


(.0246) 


(.0189) 





(millions of dollars) 
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V. COMPARATIVE USEFULNESS OF THE MODELS 
IN COST-EFFECTIVENESS ANALYSIS 



A. MODEL LIMITATIONS 

Each model chronicled in this thesis provides its own 
unique perspective on the question of cost-effectiveness. 
Comparisons among the models pointed out some of the limita- 
tions of each, and also provided insight into possible 
remedies of those limitations. 

1 . Linear Economic Models 

As a tool for validation, these models seemed to 
provide no definite answer. Using the same case data, they 
gave singly directed results compared to their continuous 
analogs, in Job Cost Models, which provided highly mixed 
results. The limitations of linearity for extrapolation be- 
came readily apparent when the models were tested using cases 
drawn from ranges quite different from those used to construct 
the model. Increased data to allow more homogeneous selection 
of base cases would tend to minimize this problem. The linear 
models used were not able to deal with inflation, in a manner 
such as version 1 of the Job Cost Models could. Expression 
of the resource coefficients for material and overhead in 
real monetary units would lessen this problem. Changing work 
type requirements could not be handled well by the aircraft 
linear model. However, the process Myers outlined for the 
engine pro ram would be better able to make the accommodations 
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for some of these time related changes by defining new processes 
for each quarter. As Myers pointed out, the clustering method 
would require more data to be meaningful. 

2 . Daily Cost Models 

Tye noted the major limitations for both models he 
examined [9, Chap. V]. These were the effects of: price 

changes for overhead and material cost, NORM redefinition, 
and changes in work required in terms of subprogram mix. He 
felt that these were not treated effectively by the models. 

He also noted the computational problem of the first stage 
regression of the CES function and the subsequent accuracy 
limitations . 

3 . Job Cost Models 

Both versions of the Job Cost Model were subject to 
unstable treatment of congection effects. The alternate 
explanation of pressure effects cast doubt over the exact 
nature of the measurement. Possibly by forming the product 
of NIS and NDAYS, a variable would be created which indeed 
would measure congestion. This product would be a job density 
over the period of rework for the particular job considered. 
Substituting this composite measure for NIS in version 1 
might provide more satisfactory results. 

B. INTERPRETATIONS OF MODEL H^^RMONY OR DISCORD 

In developing cost-effectiveness criteria it was necessary 
to propose what was to be expected if indeed WIPICS had 
provided a cost savings for NARFNI . In other words, v;hat 
conditions would be indicative of improvement in the facility's 
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cost flow or work flow? An extensive list of single items 
could be made, attacking a ceteris paribus condition to each. 
Such ceteris paribus conditions were clearly not likely, 
and hence the models attempted to take on the job of 
accounting for more than one changing condition at a time. 

It was clear that if all of the different models that were 
used distinctly proclaimed the after WIPICS situation better 
by their own measures, there was firm ground for declaring 
WIPICS cost-effective. Only those known frailities of the 
models would have to be appended to the pronouncement as 
warnings . 

But what sort of second best situation might apply? 
Surely, if most models had indicated superiority of the after 
WIPICS situation and the others had indicated parity, a 
similar cost-effective declaration would have been in order 
subject to minor reservations. Even an element of opposite 
indications could have been tolerated if an explanation of 
the opposite effects better than that provided by WIPICS 
could be demons trai ted . Naturally, these arguments apply 
equally well reversed for indications of a more costly or 
less productive after-WIPICS situation. 

But what of models that stood opposed to each other, 
firmly based? One might porpose a democratic, "majority 
wins," approach, but the answer would better lie in a 
thorough examination of model accuracy by measures of fit 
and variability accounting. The conflicting models would 
have to be checked for the assumptions on which they were 
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based, also. Further, any limitations of the models explana- 
tory abilities would also have to be weighed. Those factors 
not considered at all by each respective model would have 
to be evaluated. For fit and variance explanation, the 

measures of standard error and the coefficient of determina- 
2 2 

tion (R /Fg) could be compared. Realism would provide a guage 
for the assumptions. Limitations and omissions would require 
judgments based on operational experience. 

Another possible situation can be constructed. This 
would be the situation vi^here there existed not only inter- 
model conflict, but intra-model disagreement as well. This 
situation would seem to be the best characterization of the 
results reported in this thesis. Far from being a discordant 
presentation of meaningless contradiction, however, the 
situation provided increased reason to believe that there 
were other factors to consider which had been omitted and. 
that these factors were of some importance. At the same 
time some factors may be present that faithfully mask all 
attempts at isolating others that would be important and 
indicative. Some of the factors omitted and masking have 
been discussed above as limitatior^ - such as inflation and 
better measures of congestion. Thus it would be appropriate 
to reconsider some of the structures used in the model 
development . 

An alternative explanation of the discord is possible. 

In an effort to maintain strict comparability between the 
linear model and the job cost model, the base cases used were 
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chosen to match by aircraft type/v;ork type and to include as 
many observations in those cases as possible for more meaning- 
ful estimations. It is possible that in doing so, the 
respective base cases were so atypical that they forced 
unlikely results. Some indications, notably by comparison of 
the production vectors expressed in terms of NOFy'^, would 
provide good reason to hold this view. This could be checked 
by adding observations from another quarter and repeating 
the procedures. 

Returning to a situation in which WIPICS would have been 
deemed cost-effective on the basis of the models presented, 
it would be a natural extension to inquire about extending 
the use of WIPICS at other NARFs. The analyses would provide 
a valuable basis for considering such an extension, but the 
methodology would be even more valuable in checking the 
desirability of such an extension. The methodology has 
provided a means for estimating the production and cost flows 
of a facility and could be used to determine if there v;as 
sufficient similarity at the proposed location to make 
extension appropriate. If a model characterized the proposed 
activity as not being presently subject to congestive slow- 
downs, this portion of the WIPICS "cure" would probably be 
lost. The models also provide a tool for planning. If, in 
the face of budget reductions , it was anticipated that NARF 
activities would b* scaled down, this situation could be 
analyzed to determine whether the benefits of WIPICS v;ould 
still be realized. This could be accomplished by using 
planned data as a base case for the models . 
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C. IMPACT OF OTHER FACTORS 



Tye's thesis and the present work used data to represent 
the after WIPICS period that began with observations very 
near the initiation of WIPICS. As Tye points out in his 
concluding chapter, WIPICS was not truly fully operational 
until October of 1972 [9, p. 47] . Even if it had been 
operational at the beginning of 1972, there would be suf- 
ficient reason to delay any denotation of an after-WIPICS 
period until after a long enough interval of time had passed 
that the system became routinely operational. The WIPICS 
related equipment required a learning period as would any 
mechanical device. Hence real effects would probably not 
be expected immediately. Ignoring work before, say, 1 July 
1972 would decrease the learning period effect. To accom- 
plish any meaningful results would again require additional 
later data. Each of the models would probably show clearer 
results from this extension. 

Each of the cost models primarily dealt with the total 
cost figure for the basis of the analysis. Unfortunately 
the WIPICS effect, if any, might have been buried in doing 
so. It would probably be beneficial to eliminate from the 
cost accumulations, on both daily and job bases, the direct 
labor and material costs. By accounting definition and 
usage there would be little, if any, expected impact of 
WIPICS on these costs which constitute the largest share of 
the cost burden. WIPICS v/ould have the largest impact on the 



89 



«>:IJ 

f ijim/ 
xaqo 
an 

< aX®*! 

3 d 

ii 

’itfX 

-aa 

-■*P03 

vli 

. 09 
:oa 
f r 
..(» 

- M 



the overhead and penalty costs. Eliminating labor and 
material costs would also eliminate many of the additional 
problems and complications of explaining them. 
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VI. CONCLUSIONS AND ARFAS FOR FUTURE STUDY 



A. CONCLUSIONS 

Previously described cost models of the NARFNI and their 
results concerning before and after WIPICS time periods were 
reviewed. Linear Economic Models were updated with more 
recent data to provide before and after WIPICS comparisons. 

Job Cost Models using dummy variables to account for differ- 
ing work types were introduced and exercised on before and 
after data. Comparisons of the models indicated extensive 
inter-models and intra-model conflict. It was concluded that 
this conflict indicated either missing explanatory factors or 
excessive extraneous detail of the models. Limitations and 
possible remedies were suggested for the models presented. 

The following table summarizes the conflict within and 
between the models. In this table the cost differentials 
have been computed as the before-WiPICS predicted cost minus 
the after-WIPICS predicted cost. Hence a positive value 
would indicate cost reduction predicted for the after-WIPICS 
situation, and a negative value a cost increase. Tye ' s 
comparisons for the Daily Cost Models are added for further 
comparison. 

B. AREAS EOR FUTURE STUDY 

1. Myers provided a method for using clustering analysis 
to indentify processes that aided in structuring the engine 
program model. It would be possible to consider the work 



91 









■ . » 




TABLE XXVI 



COST DIFFERENTIAL COMPARISONS 



Model 




Cost Construction 


M 


M 


Linear 




Total Cost 


-5.31 


-4.77 






Operations Cost 


-3.64 


-3.09 






Penalty Cost 


-1.97 


-1.78 


Job, Version 


1 


Total Cost 


+ 3.66 


+0.06 






Operations Cost 


+5.27 


-0.36 






Penalty Cost 


-8.68 


+0.27 


Job, Version 


2 


Total Cost 


-4.49 


+1.85 






Operations Cost 


-5.28 


+1.16 








(Before 

WIPICS 

Data) 


(After 

WIPICS 

Data) 


Daily, Cobb- 


Douglas 




+17,885 


+9,241 


Daily, CES 






+ 3,306 


+7,129 



Values are millions of dollars for the Linear and Job models 
and dollars per day in the daily models. 



types alone rather than the aircraft type and work type 
together to develop fewer categories and possibly produce more 
than one process among those work types. There appeared to 
be some indication of similarity among aircraft, especially 
where they differ only by model or special configuration. 

This might provide additional information concerning alterna- 
tive resource utilizations and allow sensitivity analysis of 
the aircraft program effort. 

2. The engine program since it was not affected by WIPICS 
implimentation provides a standard for control. The engine 
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program job mix v;ould probably fluctuate in a manner similar 
to the aircraft program. The effects of the level of activity 
on production rates could be investigated. The impact of 
growth in NORM could be examined for effects on the ability 
to predict a valid functional relationship. Although the 
two programs have been treated as independent to date, any 
interface between aircraft and engine programs might be 
investigated. This interface could especially be checked 
for interference with WIPICS. Conclusions drawn about 
changes in engine program productive factors might shed light 
on similar factors within the aircraft program which are 
changing wholly outside of WIPICS influence. The aircraft 
program might be then reexamined with the highlighted factors 
diminished or deleted. 
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APPENDIX A 



JOB COST MODEL REGRESSION AND PREDICTION PROGRAM 

A. PURPOSE 

This program provides regression equation coefficients 
and statistics for a log-linear model of the job cost flow 
at NARFNI using as a basis the actual observations of job 
financial records. Data used is that contained in the Produc- 
tion Performance Reports issued quarterly by NARFNI. The 
program continues beyond the regression, if desired, to 
predict values of various cost constructions based on the 
equation estimated by the regression procedure. Additional 
data sets of actual data may be used for the prediction, in 
which case comparison may be made between actual and predicted 
values. Alternatively, hypothetical or planning data may 
be used for the prediction, in which case the predicted cost 
values would serve a budgeting function. 

B. INPUTS 

A header card, five control cards, and two data sets are 
required for the regression procedures. Additional sets of 
data may be included as desired for prediction. In the 
descriptions that follow, "CC” indicates card column on a 
computer punch card. 

1. Header Card: 

CC 1-40 Any alphanumeric title of heading for 
the model 
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CC 41-42 The number of additional sets of 
data to be used for prediction, 

^ 99, right justified in the field. 
Zero or blank indicates no predic- 
tion . 



2. Control Cards 

first: CC 1-4 The number of explanatory variables 

to be used in the regression. ("LI") 

CC 8 Zero (blank) or one for exclusion 
or inclusion, respectively, of the 
penalty cost computation from the 
desired cost construction ("NOGO") 

CC 9-12 The number (< 1600) of data cards 
for the regression plus one. 
("NSTOP") 

CC 13-16 The value, separately computed, to 
be used in prediction for those 
jobs lying in "tail" periods to 
indicate average number in shop. 
("NIS") May be blank if predic- 
tion is not desired. 

second: The twenty two-digit aircraft type codes, 

in numerical order, without spaces 
betv/een. ("IMATR") 

third, fourth, fifth cards: penalty costs per day 

for the aircraft types identified in the 
second control card above , in the same 
order. ("PMA.TR") Third and fourth card 
contain eight nine-digit fields, one 
place of which may be a decimal point. 

The fifth card contains the remaining 
four nine-digit fields. 

3. Aggregated Prorated Data Deck 

The output from the Aircraft Prorate Program 
[ref. 8, App. D) from Julian date 0069 through 
the highest production date. Add one blank card, 
if there is a non-zero number in shop on the last 
day . 

4 . Regression Data 

Raw data cards in the format given by Myers [8, 

App. A] . Cards are in order by aircraft type 
and, v/ithin aircraft type, by work type. Exactly 
NSTOP-1 cards must be entered. 
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5. Prediction Data 



As many additional decks as indicated on the 
header card may be included. Repeat the set of 
control cards, adjusting the first card to match 
the prediction data set in number of cards and 
NIS value. The Aggregated data is not repeated. 



C. OUTPUTS 

Statistical results and a list of computed estimates for 
the dummy and explanatory variables are printed for the 
regression procedures. Each step of the stepwise procedure 
is printed. For the prediction procedures, the predicted 
values of the input jobs are accumulated and the total is 
printed along with the total actual value and statistical 
parameters . 

D. SPECIAL NOTES 

Construction of the particular cost dependent variable 
is done in the Read subroutine, where one of the two given 
statements is chosen depending on the construction desired. 
Changes between versions are made by interchanging the card 
"X(J, 2 )=..." in the same subroutine. Expansion of the 
program for increased number of explanatory variables and 
data cards can be accomplished by increasing appropriate 
DIMENSION values. The subroutine LOC is also required from 
the IBM Scientific Subroutine Package. 

The author wishes to thank Assistant Professor Norman K. 
Womer, formerly of the Naval Postgraduate School for con- 
tributing the computer program appearing in this Appendix. 
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APPENDIX B 



JOB COST MODEL DUMMY VARIABLE COEFFICIENTS 

1. Job Cost Model categories are identified below. 

2. All values are given in scientific notation, i.e., 

s t 

0.4 34 5D01 means 0.4345 times raised to the 1 power or 

4.345. 



BEFORE WIPICS AFTFR WIPICS 

CATEGORY IDENTIFICATION CATEGORY IDENTIFICATION 



TYPE 


WORK 


C4T 


NUMBER 


TYPE 


WORK 


CAT 


NUNBER 


1C 


4 


1 


3 


10 


4 


1 


a 


11 


3 


2 


22 


1 1 


2 


2 


9 


21 


2 


3 


49 


1 1 


6 


3 


2 


21 


4 


4 


16 


21 


2 


4 


24 


21 


5 


c 


3 


21 


4 


5 


8 


21 


6 


6 


2 


21 


5 


6 


4 


22 


1 


7 


1 


21 


6 


7 


9 


22 


2 


8 


14 


2 1 


7 


8 


4 


22 


4 


9 


24 


22 


5 


9 


15 


22 


5 


10 


22 


22 


6 


10 


3 


22 


6 


11 


7 


23 


2 


11 


1 


23 


3 


12 


1 


23 


4 


12 


a 


23 


4 


13 


5 


25 


2 


13 


I 


25 


2 


14 


19 


25 


4 


14 


2 


25 


6 


15 


9 


25 


5 


15 


2 


26 


2 


16 


7 


25 


6 


16 


2 


26 


6 


17 


1 


26 


4 


17 


1 


27 


2 


18 


4 


26 


5 


18 


1 


27 


6 


19 


8 


27 


2 


19 


1 


31 


2 


20 


3 


27 


6 


20 


1 


32 


2 


21 


3 


33 


2 


21 


4 


33 


2 


22 


1 


33 


3 


22 


18 


33 


9 


23 


1 


34 


1 


23 


1 


34 


3 


24 


52 


34 


2 


24 


2 


35 


2 


25 


2 


34 


3 


25 


6 


41 


2 


26 


7 


35 


2 


26 


2 


42 


2 


27 


12 


42 


2 


27 


9 


42 


4 


28 


2 


43 


2 


28 


16 


43 


2 


29 


24 


43 


4 


29 


1 


44 


2 


30 


1 


43 


6 


30 


3 


45 


2 


31 


2 


48 


2 


31 


4 


48 


2 


32 


7 


48 


6 


32 


1 


48 


7 


33 


13 


48 


7 


■a a 


c. 


48 


8 


34 


5 


48 


8 


34 


3 


49 


2 


35 


1 


49 


2 


35 


15 


49 


7 


36 


1 


49 

49 


7 

8 


36 

37 


a 

4 
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VERSION 1 BEFORE UPICS TOTAL COST 



CCRRESPQNCING TO THE MODELS OF THE SAME TITLE IN CHAPTER IV, 
THE COEFFICIENTS CF THE DUMMY VARIABLES AND THEIR RELATED 
STATISTICS ARE GIVEN BELOW. THE CATEGORY NUMBERS REFER TO 
AIRCRAFT TYPE-WORK TYPE COMBINATIONS GIVEN ON THE FIRST PAGE 
OF THIS APPENDIX. 



EGCRY 


COEFFICIENT 


STD ERROR 


T STATISTIC 


1 


C. 43450 


01 


0. 61870 


00 


0.70220 


01 


2 


0.4399 D 


01 


0.619CD 


00 


0.7 1070 


01 


3 


0. 4010D 


01 


0.61990 


00 


0 .64680 


01 


A 


0.411ID 


01 


0.6 1920 


00 


0.664CD 


01 


5 


0.4037D 


01 


0 .62130 


00 


0 .64970 


01 


6 


0.4054D 


Cl 


0.62080 


00 


0.653CC 


01 


7 


0 .4287D 


0 1 


0 .62 150 


OC 


C. 63980 


01 


8 


0.4107D 


01 


0.61880 


00 


0 .66380 


01 


9 


0.4180D 


01 


0.61870 


OC 


0.67570 


01 


10 


0 .4244D 


0 1 


0.61960 


00 


0.685C0 


01 


11 


0.4137D 


01 


0.61910 


00 


0 .66820 


01 


12 


0.4057D 


Cl 


0.6 2130 


00 


0.653CD 


01 


13 


0.4L95C 


01 


0 .62500 


00 


0 .67 1 ID 


01 


14 


C. 39480 


01 


0.61840 


00 


0.63830 


01 


15 


C.4023D 


C 1 


0.61890 


OC 


0.650 ID 


01 


16 


0.3951D 


01 


0 .6 1890 


00 


0.63350 


Cl 


17 


C.4054D 


Cl 


0.61990 


00 


0.65400 


01 


13 


0 .39360 


01 


0 .6 1840 


00 


0.63650 


01 


19 


0 .39770 


01 


0.62010 


00 


0 .64140 


01 


2C 


0.38430 


Cl 


0. 6 1830 


00 


0.62240 


01 


2L 


C. 38820 


01 


0.61850 


OC 


0.62760 


01 


22 


0.37290 


01 


0.61950 


00 


0 .60200 


01 


23 


0.40130 


01 


0.62800 


00 


0.63 910 


01 


24 


0.38070 


01 


0 .6 1750 


00 


0.61640 


01 


25 


0.37740 


01 


0.62110 


00 


0.O0760 


01 


26 


C .37850 


0 1 


0 .61850 


00 


0.6 1 190 


01 


27 


C. 37630 


01 


0 .6 1790 


00 


0 .60890 


01 


28 


C. 33230 


01 


0. 62180 


00 


0.61490 


01 


29 


C .37240 


01 


0 .6 1690 


CO 


0.60 170 


Cl 


30 


C. 37680 


01 


0.62580 


00 


0 .60210 


01 


31 


0.37700 


01 


0.62170 


00 


0.60640 


01 


32 


0.39220 


01 


0.6 17 ID 


00 


0 .63550 


01 


33 


C. 39360 


01 


0.61 9L0 


00 


0 .63570 


01 


34 


C. 38440 


01 


0.61640 


00 


0.62260 


01 


35 


C. 37980 


01 


0 .62190 


00 


0.61070 


01 


36 


C. 38640 


01 


0.61820 


00 


0.62500 


01 
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VERSION 1 AFTER WIPICS TOTAL COST 



CORRESPONDING TO THE MODELS OF THE SAME TITLE IN CHAPTER IV, 
THE COEFFICIENTS CF THE DUMMY VARIABLES AND THEIR RELATED 
STATISTICS ARE GIVEN BELOW. THE CATEGORY NUMBERS REFER TO 
AIRCRAFT TYPE-WORK TYPE COMBINATICNS GIVEN ON THE FIRST PAGE 
OF THIS APPENDIX. 



CATEGORY 


COEFFIC lENT 


STD ERROR 


T STATISTIC 


1 


0 .2264D 


01 


0 .90 19D 


00 


0.25 ICO 


01 


2 


C.2346D 


Cl 


0.9002D 


00 


C.2605C 


01 


3 


0.2284D 


Cl 


0.90 120 


CC 


C.2524D 


01 


4 


0.2039 D 


01 


0 .8989D 


00 


0.2268D 


01 


5 


C.2060D 


01 


0. 90320 


00 


C.2281C 


01 


6 


0.2031D 


01 


0.902C3 


00 


0. 225C0 


01 


7 


C.1998D 


01 


0 .8994D 


00 


0 .2221C 


01 


8 


0.2015D 


01 


0. 90C2D 


OC 


C.2239C 


01 


9 


0 .2083D 


0 1 


0.905 ID 


00 


0.23C10 


01 


10 


0. 2078D 


Cl 


0.90480 


00 


0 .2296C 


01 


1 1 


0.2024D 


Cl 


0.9C390 


00 


0.22390 


01 


12 


0 .2007C 


01 


0 .89960 


00 


0.222 10 


01 


13 


0.2079D 


01 


0. 8963D 


00 


0.23 19D 


01 


14 


C .20 12D 


0 1 


0.90C8D 


00 


0.2223D 


Cl 


1 5 


0.2029 D 


01 


0 .9021D 


00 


0 .2250C 


01 


16 


C. 1997D 


01 


0. 9CC9D 


OC 


0.2216C 


01 


17 


0.200 ID 


0 1 


0.89890 


00 


0.2226D 


Cl 


18 


0 . 20 1 8D 


01 


0.9032D 


00 


0 .2234C 


01 


19 


C. 1353D 


Cl 


0. 89730 


OC 


C . 2 06 7D 


01 


20 


C.1921D 


01 


0.90140 


00 


0 .213 ID 


01 


21 


C. 199hC 


01 


0.89560 


00 


0.2227C 


01 


22 


C. 1966D 


01 


0 .89 380 


OC 


C.22CCD 


Cl 


23 


C .2097C 


01 


0 .90 1 ID 


00 


0 .2327D 


01 


24 


C.2065D 


Cl 


0.90570 


CC 


C.2278C 


01 


25 


0. 1982D 


01 


0 .8957D 


CO 


0.22 12D 


01 


26 


0.20130 


01 


0 .8904D 


00 


0 .2246C 


01 


27 


C . 1980D 


01 


0. 8951D 


CC 


0.2213D 


01 


23 


C.2009D 


01 


0 .89240 


00 


0 .22520 


01 


29 


C . 19o4D 


01 


0.88580 


00 


0 .22 17C 


01 


20 


C . 1987D 


01 


0.8944D 


00 


0.222 ID 


C 1 


31 


C .2030 0 


01 


0 .8920D 


00 


0 .2275C 


01 


32 


C.2042D 


01 


0. 8984D 


00 


0.2273C 


01 


33 


0. 19 79 0 


01 


0.8979D 


OC 


0 .22240 


Cl 


34 


C. 1951 0 


01 


0.89550 


00 


0 .2179C 


01 


35 


0. 1975D 


01 


0. 8941D 


00 


0.22C9D 


01 


36 


0. 19450 


01 


0 .89680 


00 


0 .2 1690 


Cl 


37 


C. 19830 


01 


0. 89o7D 


00 


0.22 12C 


01 
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VERSION 1 BEFORE WIPICS 



OPNS COST 



CORRESPONDING TO THE MODELS OF THE SAME TITLE IN CHAPTER IV, 
THE COEFFICIENTS CF THE DUMMY VARIABLES ANC THEIR RELATED 
STATISTICS ARE GIVEN BELOW. THE CATEGORY NUMBERS REFER TO 
AIRCRAFT TYPE-WORK TYPE COMBINATIONS GIVEN CN THE FIRST PAGE 
OF THIS APPENDIX . 



CATEGORY 


COEFFIC lENT 


STD ERROR 


T STATISTIC 


1 


0.3233D 


01 


0 .63980 


00 


0 .50530 


01 


2 


C.3345D 


Cl 


0. 64C1D 


00 


C.5226C 


01 


3 


0 .3245C 


01 


0.64 IID 


00 


0.50630 


01 


4 


C.3308C 


01 


0 .64030 


00 


0 .51670 


01 


5 


0.3278D 


01 


0. 64250 


OC 


C.51 C20 


01 


6 


0.3263C 


01 


0 .t)4 190 


00 


0 .50840 


01 


7 


C. 33930 


01 


0.64270 


00 


0 .52790 


01 


8 


C.3305D 


01 


0 .63990 


OC 


0. 51650 


0 1 


9 


0.3373C 


01 


0 .63980 


00 


0 .52750 


01 


LO 


C. 342 70 


01 


0. 64070 


00 


0.53490 


01 


1 L 


0.33310 


0 1 


0 .64C2D 


OC 


C.52C3D 


Cl 


12 


0.32870 


01 


0 .64250 


00 


0 .51 UC 


01 


13 


C.3377D 


01 


0.64630 


OC 


C. 52250 


01 


14 


0 .31830 


0 1 


0.63950 


OC 


0.49770 


01 


15 


0.32460 


01 


0 . 64 CCD 


00 


0 .50720 


01 


16 


0.31870 


01 


0. 64CCD 


00 


0.498CD 


01 


17 


0.3301 C 


01 


0 .64100 


00 


0 .51500 


01 


18 


C. 32200 


Cl 


0.63940 


00 


0.5035C 


01 


19 


0.32590 


Cl 


0.64 120 


00 


0.50830 


Cl 


2C 


0 .3131 D 


01 


0 .63940 


00 


0 .48970 


Cl 


21 


C.3139U 


01 


0. 63960 


00 


0.49080 


01 


22 


0.29570 


0 1 


0 .64C60 


00 


C. 46 150 


C 1 


23 


0.32520 


01 


0 .64940 


00 


0 .50080 


01 


24 


C. 30690 


01 


0.63860 


cc 


C.48C60 


01 


25 


0.30580 


01 


0.64230 


00 


0 .47620 


01 


26 


0.3072D 


Cl 


0 . 63 96 0 


00 


0 .48030 


01 


27 


0.30520 


Cl 


0.639C0 


OC 


0.47760 


01 


20 


0 .31160 


01 


0 .64300 


00 


0 .43470 


01 


29 


C. 29970 


01 


0. 64CC0 


00 


0.46330 


01 


30 


C .309 ID 


0 1 


0 .64720 


00 


C. 47760 


C 1 


31 


0.30750 


01 


0 .64290 


00 


0 .47830 


01 


32 


C. 32130 


01 


0.63820 


CC 


C. 50350 


01 


33 


0.32530 


01 


0.64020 


00 


0.50aCD 


01 


34 


C.3153D 


01 


0.63740 


00 


0 .49460 


01 


35 


C. 31030 


01 


0. 64310 


00 


C. 48250 


01 


36 


0 .3184D 


01 


0.63930 


00 


0 .498 ID 


01 
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VERSION 1 AFTER UIPICS 



CPNS COST 



CORRESPONDING TO THE MODELS OF THE SAME TITLE IN CHAPTER IV, 
THE COEFFICIENTS CF THE DUMMY VARIABLES AND THEIR RELATED 
STATISTICS ARE GIVEN BELOW. THE CATEGORY NUMBERS REFER TO 
AIRCRAFT TYPE-WORK TYPE COMBINATIONS GIVEN CN THE FIRST PAGE 
OF THIS APPENDIX. 



CATEGORY COEFFICIENT 



1 


C. A2ACD 


OG 


2 


0 .A80AD 


00 


3 


0. A186D 


OC 


A 


0. A612D 


oc 


5 


0 .A37AD 


00 


6 


0. A2 03D 


oc 


7 


0 .A29AD 


oc 


8 


0.A389C 


00 


9 


0. A3A2D 


oc 


10 


0.A198D 


00 


1 1 


C.AAA9D 


00 


12 


C.A16AD 


oc 


13 


0 .A9 23D 


00 


lA 


C. A109C 


cc 


15 


C. A099D 


oc 


16 


0.A133D 


00 


17 


0.3977D 


oc 


18 


0 .A05AD 


00 


19 


0.2571D 


00 


2C 


0.3777D 


cc 


2 1 


0 .A9 36D 


00 


22 


0. A519D 


00 


23 


C.A957D 


cc 


2A 


0 .A295D 


oc 


25 


C. A766D 


00 


26 


C.5329D 


oc 


27 


C .A968D 


00 


28 


C.5215D 


cc 


29 


0 .A6AAD 


00 


30 


0.A7960 


00 


3 1 


0. 5A5AD 


oc 


32 


0.5291D 


00 


33 


C. A9A2D 


oc 


3A 


C.A6A2D 


oc 


35 


C.A85AD 


00 


36 


C.A599D 


00 


37 


0.A9A0D 


00 



STD ERROR 


T STATISTIC 


0. 989AD 


OC 


C.A285C 


CO 


0.9876D 


00 


O.A86AD 


00 


0.9887D 


00 


0 .A23AC 


00 


0. 9861D 


00 


C.A677D 


CO 


0.9908D 


00 


0 .AA15D 


00 


0.9906D 


00 


0 .A2A3C 


00 


0 .9867D 


OC 


0.A352D 


CO 


0 .9875D 


00 


0 .AAA5C 


00 


0. 9929D 


00 


0.A373C 


00 


0.9926D 


00 


C.A229D 


0 0 


0 .9916D 


00 


0 .AA87C 


00 


0. 9869D 


00 


0.A2 190 


00 


0.9823D 


00 


C.50C7D 


00 


C.9882D 


00 


0 .A158C 


00 


0.98970 


oc 


O.Al A2D 


00 


0 .9683D 


00 


0.A1S2D 


CO 


0.9861D 


00 


0 .AO 330 


00 


0 .99080 


00 


0. A09 ID 


CO 


0 .98A3D 


00 


0 .26 12C 


CO 


0. 9888D 


cc 


C.382CC 


00 


0 .982AD 


oc 


0 .502AD 


CO 


0 .98050 


00 


0.A609C 


00 


0. 9885D 


CO 


0.50150 


00 


0 .9935D 


00 


0 .A322D 


00 


0 .98260 


00 


0.A863C 


00 


0.983AD 


oc 


0.5A 190 


00 


0 .98 19D 


00 


0.5059C 


CO 


0. 979CD 


oc 


C.5326C 


00 


0.97 17D 


00 


0. A779D 


CO 


0 .98120 


00 


0 .A888C 


00 


0. 9785D 


00 


0.55730 


00 


0 .98560 


00 


0 .53690 


00 


0.98510 


00 


0 .50170 


00 


0.982AD 


00 


0.A725D 


00 


0 .98090 


GO 


0.A9A8D 


00 


0.98380 


OG 


0.A675C 


00 


0.98260 


00 


C. 50220 


00 
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VERSION I BEFORE WIPICS PENALTY CCST 



CCRRESPCNDING TO THE MODELS OF THE SAME TITLE IN CHAPTER IV, 
the coefficients CF THE DUMMY VARIABLES AND THEIR RELATED 
STATISTICS ARE GIVEN BELOW. THE CATEGORY NUMBERS REFER TO 
AIRCRAFT TYPE-WORK TYPE COMBINATIONS GIVEN CN THE FIRST PAGE 
OF THIS APPENDIX. 



CATEGCRY CCEFFICIENT 



1 


C. 5533D 


01 


2 


0.5565C 


0 I 


3 


0.4886D 


01 


4 


C.5051D 


01 


5 


0 .4903D 


01 


6 


0.4979D 


01 


7 


0. 5359D 


01 


8 


0 .5048D 


01 


9 


C.5125D 


01 


10 


C. 52090 


01 


1 1 


0.5083D 


01 


12 


C.4942D 


Cl 


13 


0 .5166D 


0 1 


14 


0.4825D 


01 


15 


0.4918D 


01 


16 


0 .4827D 


01 


17 


C. 491 ID 


01 


18 


C.47C3D 


01 


19 


0.4752D 


01 


20 


C.4625D 


01 


21 


0.47 19 C 


0 1 


22 


0.4624D 


01 


23 


0.4889D 


Cl 


24 


0 .4633D 


01 


25 


C.4552C 


Cl 


26 


0.4554D 


Cl 


27 


0.4528D 


01 


26 


C.4572D 


01 


29 


0 .4524D 


0 1 


30 


C.4416D 


01 


31 


C.4486D 


Cl 


32 


0 .4674C 


01 


33 


C.4599C 


01 


34 


0.4555D 


Cl 


35 


0 .4514D 


01 


36 


C.4531D 


01 



STD ERROR 


T STATISTIC 


0. 8428D 


00 


0.6565C 


01 


0 .843 ID 


00 


0.66CCD 


01 


0.8445D 


00 


0 .57860 


01 


0. 8434D 


OC 


C.5989C 


01 


0 .8463D 


00 


0.5793D 


Cl 


0 .8456D 


00 


0 .58890 


01 


0. 8467D 


00 


0.633CD 


01 


0 .8429D 


00 


0 .5989D 


01 


0.84270 


00 


0 .60320 


01 


0.844CD 


OC 


C.6172D 


01 


0 .8433D 


00 


0.60270 


01 


0 . 8463D 


00 


C. 584C0 


01 


0.85 14D 


CO 


0.606 £D 


01 


0 .8424D 


00 


0 .57270 


01 


0. 8430D 


00 


0. 5834D 


01 


0.8431D 


00 


0 .5726D 


01 


0.34440 


00 


0 .58 160 


01 


0.8423D 


00 


C. 55S3D 


01 


0 .8446D 


00 


0.56260 


01 


0. 8423D 


00 


0.54910 


01 


0.84260 


00 


C.56C ID 


01 


0 .8438D 


00 


0 .54800 


01 


0. 8554D 


OC 


0. 5716D 


01 


0.84 12D 


00 


C .55C8D 


01 


0.84610 


00 


0 .53800 


01 


0.84260 


00 


C. 54C5D 


Cl 


0 .8417D 


00 


0,53790 


01 


0. 8470D 


00 


0.53980 


01 


0.8430D 


00 


0. 5366D 


0 1 


0 .8525D 


00 


0 .518C0 


01 


0. 64690 


00 


0.52970 


01 


0 . 84060 


OC 


0.556CD 


01 


0 .8434D 


00 


0 .54530 


01 


0. 8397D 


OC 


0.5425D 


01 


0 .8472D 


00 


0 .5329D 


01 


0.8421D 


00 


0.53810 


01 
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VERSION I AFTER WIPICS PENALTY COST 



CORRESPONDING TO THE MODELS OF THE SAME TITLE IN CHAPTER IV, 
THE COEFFICIENTS CF THE DUMMY V/SRIABLES ANC THEIR RELATED 
STATISTICS ARE GIVEN BELOW. THE CATEGORY NUMBERS REFER TO 
AIRCRAFT TYPE-WORK TYPE COMBINATIONS GIVEN CN THE FIRST PAGE 
CF THIS APPENDIX. 



EGORY 


COEFFICIENT 


STD ERROR 


T STATISTIC 


1 


C.6341D 


01 


0.1445D 


01 


0 .43890 


01 


2 


0. 64570 


Cl 


0. 1442D 


01 


0.44760 


01 


3 


0 .64100 


01 


0 . 1444D 


01 


0 .44 4 00 


01 


4 


0. 5851D 


01 


0.1440D 


01 


0 . 0 6 4 D 


01 


5 


0.5956D 


0 1 


0. 14470 


01 


0.41170 


01 


6 


C.5908 D 


01 


0 . 1446D 


01 


0 .40840 


01 


7 


C. 57900 


01 


0. 1441D 


01 


C . 4 0 1 9 0 


01 


8 


0.58240 


0 L 


0 . 1442D 


0 1 


0.40390 


01 


9 


0.60230 


01 


0 . 1450D 


01 


0 .41540 


01 


10 


0.60320 


01 


0. 1449D 


01 


0.41620 


01 


1 1 


0 .58370 


0 1 


0. 1448D 


C 1 


0.403 ID 


01 


12 


C. 58410 


01 


0. 1441D 


01 


0 .40540 


01 


13 


C. 59030 


01 


0. 1436D 


01 


0.41 120 


01 


14 


0 .58690 


01 


0 . 1443D 


01 


0 .40670 


01 


15 


C. 59220 


01 


0.1445D 


01 


0.40980 


01 


16 


0 .582 ID 


0 1 


0 . 14430 


C 1 


C. 40340 


Cl 


17 


0.58570 


01 


0 . 14400 


0 1 


0 .40 6 80 


01 


18 


C . 58960 


Cl 


0. 14470 


Cl 


C. 40750 


01 


19 


0.57010 


0 1 


0 . 14370 


0 1 


0.39660 


01 


20 


C. 56430 


01 


0.1444D 


01 


0 .39080 


01 


2 1 


C. 56500 


01 


0. 1435D 


01 


0.39390 


01 


22 


C. 5649 0 


01 


0 . 14320 


0 1 


C .3945D 


01 


23 


0.59540 


01 


0.14430 


01 


0 .41250 


01 


24 


C. 59790 


01 


0. 14 5 10 


Cl 


0.412 ID 


0 1 


25 


C. 56370 


01 


0 . 14350 


0 1 


0 .39290 


01 


26 


C. 56220 


01 


0. 14360 


01 


0.39 150 


01 


27 


0.55930 


0 1 


0. 14340 


01 


0.39C ID 


Cl 


28 


C. 56380 


01 


0 .14300 


0 i 


0 .39440 


01 


29 


C. 56130 


01 


0. 14190 


Cl 


C. 39560 


01 


30 


0 . 566 3 0 


0 1 


0. 14330 


0 1 


0.39540 


01 


31 


C. 56260 


01 


0.14290 


01 


0 .39370 


01 


32 


C. 57240 


01 


0. 14390 


01 


0.39770 


01 


33 


0.55740 


01 


0 . 14380 


0 1 


0 .38750 


01 


34 


C. 55550 


01 


0 .14340 


01 


0.38730 


01 


35 


C. 55830 


01 


0. 14320 


01 


0.3896D 


Cl 


36 


0.55340 


01 


0 .14370 


01 


0 .38520 


01 


37 


C. 56000 


01 


0.14360 


01 


0.38990 


01 
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VERSION 2 BEFORE WIPICS TOTAL COST 



CORRESPONDING TO THE MODELS OF THE SAME TITLE IN CHAPTER IV 
THE COEFFICIENTS CF THE DUMMY VARIABLES ANC THEIR RELATED 
STATISTICS ARE GIVEN BELOW. THE CATEGORY NUMBERS REFER TO 
AIRCRAFT TYPE-WORK TYPE COMBINATIONS GIVEN CN THE FIRST PAC- 
CF THIS APPENDIX. 



CATEGORY 


COEFFIC lENT 


STD ERROR 


T STATISTIC 


1 


0.2418D 


01 


0 .2924D 


00 


0 .8268C 


01 


2 


C.2451D 


01 


0. 2918D 


00 


0.8398C 


01 


3 


0 .2156D 


01 


0.2925D 


00 


0 .7372D 


01 


4 


0.2159C 


01 


0.2914D 


00 


0 .7409C 


0 1. 


5 


0.2175D 


01 


0. 2943D 


CO 


C.73 93D 


01 


6 


0 .2149D 


01 


0 .29420 


00 


C. 73040 


01 


7 


C.2181C 


01 


0.2938D 


00 


0.7422C 


01 


8 


0.2184D 


01 


0.29 14D 


00 


0. 7495D 


01 


9 


0.2212C 


01 


0.29 14D 


00 


0 .759CC 


01 


LO 


C. 22270 


01 


0. 2923D 


00 


C.7618C 


01 


L 1 


0 .2195C 


0 1 


0.2922D 


00 


C . 7 5 1 2D 


01 


12 


0.2138D 


01 


0.29 13D 


00 


0 .73280 


01 


13 


C.2147D 


01 


0. 296CD 


oc 


0.7255D 


01 


14 


0 .2066D 


0 1 


0 . 29 16D 


00 


C.7085D 


01 


15 


C.2C87D 


01 


0.2920D 


00 


0 .7 1460 


0 1 


16 


0.2073D 


01 


0.29C4D 


00 


0.71390 


01 


17 


C.2135C 


01 


0 .2938D 


00 


0 . 72640 


01 


18 


C.2G39D 


01 


0.29C7D 


00 


0.70 150 


01 


19 


0.2054D 


0 1 


0 .2928D 


00 


0. 70 14D 


Cl 


20 


0 .1979D 


01 


0 .29 12D 


00 


0 .67940 


01 


2 1 


C. 19980 


01 


0. 29 ICD 


00 


0.68650 


01 


22 


0 . 1865D 


0 1 


0.2939D 


00 


0.6347D 


01 


23 


0. 1983C 


01 


0.2979D 


00 


0 .66560 


01 


24 


C. 1936D 


01 


0.2918D 


00 


0.6b34D 


0 1 


25 


0. 1897C 


01 


0 .2927D 


00 


0 .6482D 


01 


26 


C. 1918D 


01 


0.2926D 


00 


0 .6555 D 


01 


27 


0. 19 13 C 


0 1 


0.2926D 


00 


0.6537D 


01 


28 


C.1936D 


0 1 


0.29230 


00 


0 .66230 


01 


29 


C. 1871D 


01 


0.29170 


OC 


0.64130 


01 


30 


0. 190SC 


0 1 


0 .2963D 


00 


C.6438D 


01 


31 


C. 1868D 


01 


0.2927D 


00 


0 .63830 


01 


32 


C.2009D 


01 


0. 29CC0 


CO 


C. 69250 


01 


33 


0.2066C 


01 


0 .29 15D 


00 


' 0 .7087D 


01 


34 


C. 201 ID 


01 


0.2927D 


00 


0.68720 


01 


35 


C .19830 


01 


0.29550 


00 


C. 67 ICD 


01 


36 


C.2045C 


01 


0 .2941D 


00 


0.69530 


01 



VERSION 2 AFTER WIPICS 



TOTAL COST 



CGRRESPCNCING TO THE MODELS CF THE SAME TITLE IN CHAPTER IV, 
THE COEFFICIENTS OF THE DUMMY VARIABLES AND THEIR RELATED 
STATISTICS ARE GIVEN BELOW. THE CATEGORY NUMBERS REFER TO 
AIRCRAFT TYPE-WORK TYPE COMBINATIONS GIVEN ON THE FIRST PAGE 
OF THIS APPENDIX. 



CATEGORY COEFFICIENT 



1 


0 .2853D 


0 1 


2 


C.2894D 


0 1 


3 


C.2850D 


Cl 


4 


0 .2620D 


0 1 


5 


0.2608D 


01 


6 


0.2593D 


01 


7 


0.2601 C 


01 


8 


C. 26110 


01 


9 


C.2621D 


01 


1 0 


C. 26140 


0 1 


1 1 


C.26C0D 


01 


L2 


0.2569D 


0 1 


13 


C.2593D 


0 1 


14 


C. 25500 


Cl 


15 


0.25470 


01 


16 


C.2549D 


Cl 


17 


0.254OD 


Cl 


18 


0 .2556C 


01 


19 


C.2391D 


01 


20 


0.24840 


0 1 


21 


C. 25480 


01 


22 


C. 25130 


01 


23 


0.25420 


0 1 


24 


C. 25060 


01 


25 


C. 25370 


01 


26 


0.25540 


01 


27 


C. 25290 


01 


28 


0.25430 


0 1 


29 


C. 24860 


01 


30 


C. 25140 


01 


31 


0.25720 


01 


32 


C. 25600 


01 


33 


C. 25540 


Cl 


34 


0 .25270 


0 1 


35 


C. 25370 


01 


36 


0.25310 


0 1 


37 


C. 25490 


01 



STO ERROR 


T STATISTIC 


0 .34530 


CO 


0. 82780 


Cl 


0.34760 


00 


0 .83250 


01 


0.34890 


CC 


C.8167C 


01 


0.34320 


oc 


C. 76350 


01 


0.34970 


00 


0 .74570 


01 


0.35070 


00 


0.73940 


01 


0.34280 


00 


0 .75880 


01 


0 .34140 


00 


0 .76470 


01 


0.3 5410 


00 


0. 74C2D 


0 1 


0 .35270 


00 


0.741C0 


01 


0.34850 


cc 


0. 746C0 


01 


0.35C8D 


oc 


0.73230 


01 


0.34780 


00 


0 .74570 


01 


0.34590 


cc 


0.73720 


01 


0.35C4D 


oc 


C.727CD 


01 


0.34780 


00 


0 .73300 


01 


0.34540 


CO 


0. 73690 


01 


0 .34740 


00 


0.73570 


Cl 


0.34830 


00 


0.68630 


01 


0.34910 


cc 


0.71170 


0 1 


0 .33430 


00 


0.76240 


01 


0. 33830 


oc 


C. 74 2 60 


01 


0 . 35020 


oc 


0.72560 


01 


0.35310 


00 


0 .70970 


01 


0.33740 


cc 


0.75 180 


0 1 


0.33230 


00 


0 .76850 


01 


0.33350 


CO 


0.75840 


01 


0 .32930 


CO 


C. 772 ID 


01 


0 .33380 


00 


0 .74470 


01 


0. 33C0D 


oc 


C. 76 170 


01 


0.33760 


00 


0.762C0 


01 


0.34230 


00 


0 .74770 


01 


0.33590 


cc 


C.76C4D 


01 


0 .33630 


00 


0.75150 


01 


0.33 790 


00 


0.75070 


01 


0 .336CD 


oc 


0.75330 


Cl 


0 .33410 


00 


0 .763C0 


01 
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VERSION 2 BEFORE WIPICS 



QPNS COST 



CCRRESPCNCING TO THE MODELS OF THE SAME TITLE IN CHAPTER IV 
THE COEFFICIENTS OF THE DUMMY VARIABLES AND THEIR RELATED 
STATISTICS ARE GIVEN BELOW. THE CATEGORY NUMBERS REFER TO 
AIRCRAFT TYPE-WORK TYPE COMBINATIONS GIVEN ON THE FIRST PAG 
OF THIS APPENDIX. 



CATEGORY 


COEFFIC lENT 


STD ERRCR 


T STATISTIC 


1 


0. 1376D 


01 


0.43640 


OC 


0.31530 


Cl 


2 


0.1473D 


01 


0.43560 


00 


0 .33820 


Cl 


3 


C. 1430D 


01 


0. 43650 


OC 


C.32 760 


01 


4 


0. 1432D 


01 


0.43500 


CC 


0.32930 


01 


5 


0. 1460 D 


01 


0.43920 


OC 


0 .33240 


01 


6 


0.14200 


01 


0. 43910 


OC 


0.32340 


01 


7 


0. 1425D 


01 


0 .43850 


00 


0 .32490 


01 


8 


0. 1447D 


01 


0.43490 


00 


0 .33280 


01 


9 


C. 1490D 


01 


0.43490 


OC 


0.34260 


Cl 


1 0 


C.1514C 


01 


0 .43630 


00 


0.34690 


01 


11 


0 . 1464D 


Oi 


0 . 43 610 


00 


0.33570 


01 


12 


0. 1427D 


01 


0 .43 5 50 


CC 


0.32760 


Cl 


13 


0.1442D 


01 


0.44180 


00 


0.32650 


01 


14 


C. 1353D 


Cl 


0. 43530 


CC 


C.31C70 


01 


15 


0. 1382D 


01 


0.43580 


CC 


0.31710 


Cl 


16 


0 . 13 53 D 


Cl 


0 . 43340 


00 


0 .31220 


01 


17 


0.14510 


Cl 


0. 43 860 


CC 


0.33C6D 


01 


18 


0 . 1377D 


01 


0 .43390 


GO 


0.31740 


01 


19 


C. 1403D 


01 


0.43710 


00 


0 .32090 


01 


20 


C. 1307D 


Cl 


0.434 70 


CC 


C.30C6D 


01 


21 


C .1304D 


01 


0.43430 


00 


0.30030 


01 


22 


C. 1140D 


01 


0. 43860 


00 


0.260CC 


01 


23 


0. 13260 


01 


0 .44 4 70 


OC 


0.29820 


Cl 


24 


C.1247D 


01 


0.43560 


00 


0.28640 


01 


25 


C. 1227D 


01 


0. 43690 


CC 


C.28C8D 


01 


26 


0 . 1253D 


01 


0.43670 


00 


0.28680 


01 


27 


C. 1245C 


01 


0.43680 


00 


0 .28500 


01 


28 


0. 1276D 


01 


0. 43630 


00 


C. 29240 


01 


29 


0 . 1183D 


01 


0 .43540 


00 


0.27170 


01 


30 


C. 12690 


01 


0.44230 


00 


0.23680 


01 


31 


C. 1227D 


Cl 


0.43690 


OC 


0.20G8D 


01 


32 


0 .1362D 


01 


0 .43290 


00 


0 .3 1460 


01 


33 


C. 142 7D 


01 


0.435 ID 


00 


0.32790 


01 


34 


0. 13600 


0 1 


0.43690 


OC 


0.31120 


01 


35 


C. 13150 


01 


0 .44110 


00 


0 .29820 


01 


36 


C. 13990 


01 


0. 439C0 


CC 


C. 31 870 


01 
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VERSION 2 AFTER WIPICS 



OPNS COST 



CORRESPONDING TO THE MODELS CF THE SAME TITLE IN CHAPTER IV, 
THE COEFFICIENTS CF THE DUMMY VARIABLES AND THEIR RELATED 
STATISTICS ARE GIVEN BELOW. THE CATEGORY NLMBERS FEFER TC 
AIRCRAFT TYPE-WORK TYPE COMBINATIONS GIVEN ON THE FIRST PAGE 
OF THIS APPENDIX. 



CATEGORY COEFFICIENT 



1 


C.2156C 


01 


2 


C.22 04D 


01 


3 


0 .2143D 


0 1 


4 


0 .2188D 


01 


5 


C.2165D 


01 


6 


0 .2146D 


0 1 


7 


0.2159C 


01 


8 


0 .2172D 


01 


9 


0 .2160D 


01 


10 


0.2147D 


01 


1 L 


0.2177D 


Cl 


12 


C.2134D 


0 1 


13 


C.22C5D 


01 


14 


C.21 38D 


0 1 


15 


C.2133D 


01 


16 


C.2138D 


01 


17 


0.2120D 


0 1 


18 


0.2136D 


01 


19 


0 . 19720 


01 


20 


0.2102 C 


01 


21 


C.2223D 


01 


22 


C.2172D 


Cl 


23 


C.2215C 


01 


24 


C.2156D 


C 1 


25 


0.2203D 


0 1 


26 


0.2267D 


01 


27 


C.2226D 


01 


28 


0.2249C 


0 1 


29 


0.2170D 


01 


30 


C. 221 ID 


01 


31 


C.2262C 


01 


32 


C.2254D 


Cl 


33 


C.2228D 


0 1 


34 


0.2192D 


0 1 


35 


C.2207D 


01 


36 


0 .219 ID 


0 1 


37 


C.2227D 


01 



STD ERROR 


T STATISTIC 


0 .4590D 


00 


0 .4696C 


Cl 


0.4621D 


00 


0.4769C 


01 


0 .4638D 


oc 


C. 4o2 ID 


0 1 


0.4562D 


00 


0 .47960 


01 


0. 46A9D 


00 


C.4657C 


Cl 


0 .4662D 


00 


C .46 C4D 


01 


0 .4557D 


00 


0 .4737C 


01 


0. 4528Q 


oc 


C.4785D 


01 


0.4707D 


00 


0 .459CD 


01 


0 .4689D 


00 


0 .4578C 


01 


C.4632D 


00 


C.4698D 


01 


0 .4664D 


00 


0 .4576C 


Cl 


0.4623D 


00 


0.4769C 


01 


0.4599D 


CO 


C . 464 cD 


01 


0.4658D 


00 


0 .458CC 


01 


0.4623D 


oc 


C.4625C 


Cl 


0 .4592D 


00 


C .46 18D 


01 


0.4619D 


00 


0 .4o24C 


01 


0. 463 ID 


00 


0.4258D 


01 


0.4641D 


00 


0 .453CD 


01 


0.4443D 


00 


0.5003C 


01 


0 .4498D 


oc 


0.48260 


01 


0 .4656D 


00 


0,4758C 


01 


0. 4694D 


00 


C.4593C 


01 


0.4486D 


CO 


0 .49 ICO 


01 


0 .4418D 


00 


0 .5131C 


01 


0. 4433D 


GO 


C.5021D 


01 


0 .4377D 


OC 


0.5139D 


01 


0.4437D 


00 


0 .489 1C 


01 


0.43 8 70 


oc 


0. 504C0 


01 


0 .4488D 


00 


0 .50 4 CD 


01 


0.4551D 


00 


0 .4953C 


01 


0 .4465D 


00 


0.499CD 


C 1 


0.4470D 


00 


0.49C2C 


01 


0.44910 


00 


0.4914C 


01 


0.4467D 


00 


0.49C5D 


01 


0 .4441D 


00 


0 .50140 


01 
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